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Data Structure and Methods for Providing an interactive Program 

Guide 

CROSS REFERENCE TO RELATED APPLICATIONS 
This application is a continuation of United States Patent 
5 Application Serial No. 09/293,526, filed on April 15, 1999, which 
application claims benefit of U.S. Provisional patent application 
serial number 60/093,891 filed July 23, 1998; both prior applications 
are hereby incorporated by reference in their entireties. 

This application is related to contemporaneously filed U.S. 
10 Patent Application Number 09/293,535, filed April 15, 1999 (now U.S. 
Patent No. 6,584,157) (attorney docket number DIVA 071), which is 
incorporated herein by reference in its entirety. 

BACKGROUND OF THE DISCLOSURE 
The invention relates to communications systems in general 
15 and, more specifically, the invention relates to an interactive 

electronic program guide suitable for use in an interactive video 
information delivery system. 

In several communications systems the data to be transmitted 
is compressed so that the available bandwidth is used more 
20 efficiently. For example, the Moving Pictures Experts Group 

(MPEG) has promulgated several standards relating to digital data 
delivery systems. The first, known as MPEG-1, refers to the 
ISO/IEC standards 11172 and is incorporated herein by reference. 
The second, known as MPEG-2, refers to the ISO/IEC standards 
25 13818 and is incorporated herein by reference. A compressed 
digital video system is described in the Advanced Television 
Systems Committee (ATSC) digital television standard document 
A/53, and is incorporated herein by reference. 

The above-referenced standards describe data processing 
30 and manipulation techniques that are well suited to the 

compression and delivery of video, audio and other information 
using fixed or variable length digital communications systems. In 
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particular, the above-referenced standards, and other "MPEG-like" 
standards and techniques, compress, illustratively, video 
information using intra-frame coding techniques (such as 
run-length coding, Huffman coding and the like) and inter-frame 
5 coding techniques (such as forward and backward predictive 

coding, motion compensation and the like). Specifically, in the case 
of video processing systems, MPEG and MPEG-like video 
processing systems are characterized by prediction-based 
compression encoding of video frames with or without intra- and/or 

10 inter-frame motion compensation encoding. 

Over the past few years, television has seen a transformation 
in the variety of means by which its programming is distributed to 
consumers. Cable television systems are doubling or even tripling 
system bandwidth by migrating to hybrid fiber coaxial (HFC) cable 

15 as an information delivery medium. Many consumers have turned 
to direct broadcast satellite (DBS) systems to receive higher quality 
(with respect to NTSC) video imagery. Other video information 
delivery approaches using high bandwidth digital technologies, 
intelligent two way set top boxes and other methods are used by 

20 information providers to offer services that are differentiated from 
standard cable and over the air broadcast systems. 

With this increase in bandwidth, the number of programming 
choices has also increased. Leveraging off the availability of more 
intelligent set top boxes, several companies such as Starsight® and 

25 Prevue™ Guide have developed elaborate systems for providing an 
interactive listing of the vast array of channel offerings, expanded 
textual information about individual programs, the ability to look 
forward to plan television viewing as much as several weeks in 
advance, and the option of automatically programming a VCR to 

30 record a future broadcast of a television program. 

An interactive digital video on demand (VOD) service known 
as the DIVA system is manufactured by DIVA Systems Corporation 
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of Menlo Park, California. The DIVA system distributes 
audio-visual information to individual subscribers utilizing 
MPEG-like information streams. DIVA subscribers utilize 
intelligent set top terminals (STT). 
5 Unfortunately, the existing program guides have several 

drawbacks. They tend to require a lot of memory, some of them 
needing upwards of one megabyte of set top terminal memory. 
They are typically very slow to acquire their current database 
when they are turned on for the first time or are subsequently 

10 restarted (e.g., a large database may be downloaded to a set top 
terminal using only a vertical blanking interval (VBI) data 
insertion technique). Disadvantageously, such slow database 
acquisition may result in out of date database information or, in the 
case of a pay per view (PPV) or video on demand (VOD) system, 

15 limited scheduling flexibility for the information provider. 

Additionally, the user interface to existing program guides does not 
usually look like a typical television control interface; rather the 
user interface looks like a 1980s style computer display (i.e., blocky, 
ill-formed text and/or graphics). 

20 Therefore, it is seen to be desirable to provide a method and 

apparatus for providing the functionality of electronic program 
guide in a manner tending to reduce the above-described problems. 

SUMMARY OF THE INVENTION 
25 The invention provides an interactive electronic program 

guide that isolates an interaction model at the set-top box level, 
where no context is associated with any user interaction, and 
where merely the manipulation of audio and visual elements 
representing, applying, removing and shifting emphasis from one 
30 area or another. All items containing contextual information reside 
in a centralized location where they will be processed and the 
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management of network resources executed in a manner to enable 
the request context-based service request or transition. 

The invention works by combining the use of broadcast 
digital video streams with video-on-demand streams to produce a 
5 compelling audiovisual user interface. The invention uses an 
intelligent set top boxes ability to manipulate a graphics overlay 
plane displayed in conjunction with a video image on an intelligent 
analog or digital set top box. The system allows the interactions to 
carry the user from broadcast (or narrowcast) video stream to 

10 broadcast (or narrowcast) video stream, from broadcast (or 
narrowcast) video stream to pointcast video stream, and from 
pointcast video stream to broadcast (or narrowcast) video stream. 

Guide and image regions of the IEPG displays are provided 
within video streams broadcast, narrowcast or pointcast video 

15 streams provided by the head end. That is, the program guide 
information is assembled at the head end and provided as video 
information to the STTs within the system. Manipulation of video 
layer objects is accomplished by proxy manipulations of graphic 
layer objects. The STT provides (beyond tuning, demultiplexing, 

20 decoding and such operations) the ability to highlight or emphasize 
object and select a highlighted or emphasized object. The graphic 
information manipulated by the STT is received via a data stream 
(i.e., a data PID), auxiliary data, private data and the like. 
Advantageously, since there is no local storage of an entire program 

25 guide database, memory resources of the STT are conserved. 
Rather, information sufficient to e.g., describe a highlighted 
program title is included within the aforementioned data stream, 
which may be contemporaneously transmitted to the STT along 
with the video stream including the channel group/time slots 

30 including the program title. 

A program guide according to one embodiment of the 
invention comprises: a video layer comprising a plurality of video 
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objects including title objects, each title object having associated 
with it a channel and at least one time slot, the video layer being 
formed in response to a received video stream; and a graphics layer 
comprising a plurality of graphics objects including title overlay 
5 objects, each of the title overlay objects selectively imparting at 
least a visual de-emphasis to a respective title object in the video 
layer, the visual de-emphasis being imparted to title objects not 
being associated with a desired time slot. 

In another embodiments of the invention, the opacity level of 

10 the title overlay object is increased to impart the visual de- 
emphasis to a respective title object. Optionally, the title objects 
subjected to de-emphasis are substantially hidden. 

In another embodiments of the invention a color of the title 
overlay object is adapted to impart the visual de-emphasis to a 

15 respective title object. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The teachings of the present invention can be readily 
understood by considering the following detailed description in 
20 conjunction with the accompanying drawings, in which: 

FIG. 1 depicts a display screen of an interactive electronic 
program guide (IEPG); 

FIG. 2 depicts subscriber side equipment suitable for use in 
an interactive information distribution system; 
25 FIG. 3 depicts a flow diagram of a user interaction method 

suitable for use in the subscriber side equipment of FIG. 2; 

FIG. 4 depicts a high-level block diagram of an interactive 
information distribution system; 

FIG. 5 depicts a flow diagram of a user interaction method 
30 suitable for use in the subscriber side equipment of FIG. 2; 

FIG. 6 depicts a display screen of an interactive electronic 
program guide (IEPG); 
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FIG. 7A depicts a diagrammatic representation of a multiple 
program transport stream suitable for use in the interactive 
information distribution system of FIG. 4; 

FIG. 7B depicts a tabular representation of an exemplary 
5 utilization of a single program transport stream providing program 
guide information and suitable for use in the multiple program 
transport stream of FIG. 7A. 

FIGS. 8A, 8B, 8C, 9A and 9B depict respective a contextual 
flow diagrams useful in understanding the invention; 
10 FIG. 10 depicts a tabular representation of the functions of 

various keys during guide region and image region operation; 

FIGS. 11A-11C, 12A-12C, 13 and 14 depict respective display 
screens of an interactive electronic program guide (IEPG) displays 
useful in understanding the invention; 
15 FIGS. 15A and 15B together comprise a user interaction 

method 1500 according to the invention; and 

FIG. 16 depicts a flow diagram of a head end stream request 
processing method. 

To facilitate understanding, identical reference numerals 
20 have been used, where possible, to designate identical elements 
that are common within the figure. 

DESCRIPTION OF THE EMBODIMENT 
The invention will be described within the context of an 

25 interactive information distribution system, illustratively the DIVA 
interactive digital video on demand (VOD) system. However, it will 
be readily apparent to those skilled in the art that the teachings of 
the present invention may be advantageously utilized in other 
interactive video information distribution systems. 

30 FIG. 1 depicts a display screen 100 of an interactive electronic 

program guide (IEPG) according to the invention. Specifically, the 
exemplary interactive program guide screen 100 comprises a time 
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of day/date (DOT) indicator 105, a promotional "splash" object 110, a 
cable system or provider logo 115, a video barker 120 (and 
associated audio barker), a program time indicator 125, a channel 
number indicator 130, a channel identifier (text or logo) 135, a pair 
5 of channel display decrement objects 140a and 140b, a pair of 
channel display increment objects 145a and 145b, a temporal 
increment object 148, a temporal decrement object 147, a program 
grid 150 and a scrolling promotional banner 155. The interactive 
program guide display 100 is displayed on a television screen or 
10 other video presentation device in, e.g., the home of a subscriber to 
a cable television or other information distribution system utilizing 
the interactive electronic program guide. Subscriber side 
equipment suitable for receiving and displaying is described in 
detail in FIG. 2. 

15 Referring to FIG. 1, the interactive program guide display 100 

is comprised of a video layer and a graphics layer. That is, the 
IEPG display 100 is primarily formed at a central or head end 
location in, for example, a cable television system. Video 
information representative of each of the objects or elements 

20 previously described (105-155) is generated at the cable central 
processing location or a head end, and transmitted as part of a 
video stream. Thus, the actual display parameters (i.e., the size, 
shape, color, position and other visual parameters) associated with 
each object are entirely controlled at a central location. 

25 Those on screen objects which may be modified by the 

subscriber are selected by, e.g., a remote control device cooperating 
with the set top terminal, which causes the locally stored and/or 
locally generated graphical overlay objects to be manipulated in a 
manner identifying the objects on the screen produced at the head 

30 end. That is, each manipulable object or element is associated with 
a corresponding graphical overlay element (e.g., an x-y coordinate 
box or other element). The overlay element has selectively 
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emphasized or de-emphasized (e.g., selectively shading, 
highlighting coloring and the like) via manipulation of the remote 
control unit. 

Upon receiving a "select" entry from the remote control unit, 
5 the set top terminal transmits, via a back channel, the information 
that identifies the selected object to the head end. It is important 
to note that changing the emphasis of an object or element is 
performed entirely at the local level. That is, there is no change in 
the actual video information transmitted by the head end to the 
10 subscriber. Only the graphical overlay layer on the display is 
changed. 

The user interaction manipulations are those manipulations 
that are intended by the user to change a particular emphasis, or 
overlay highlighting, or overlay position on the screen. By 
15 contrast, other manipulations may be intended to change video 

information displayed on the screen such as the position (temporal 
or channel) of the program grid, selection of a promotional object 
and the like. 

The interactive program guide display 100 (i.e., the video 
20 layer provided by the head end) depicts a program offering of 10 

channels within a 1.5 hour time interval. Since there are 24 hours in 
a day, 16 video streams are required to depict 24 hours of program 
offerings of 10 channels. These 16 video streams may be included 
within a single transport stream. Thus, a user desiring to view the 
25 next 1 % hour time interval (e.g., 9:30 - 11:00) may activate a "scroll 
right" object (or move the joystick to the right when a program 
within program grid 150 occupies the final displayed time interval). 
Such activation will result in the controller of the STT noting that a 
new time interval is desired. The video stream corresponding to 
30 the new time interval will then be decoded and displayed. If the 
corresponding video stream is within the same transport stream 
(i.e., a new PID), then the stream will be immediately decoded and 
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presented. If the corresponding video stream is within a different 
transport stream, then the different transport stream will be 
extracted from the broadcast stream and the appropriate video 
stream will be decoded and presented. If the different broadcast 
5 stream is within a different broadcast stream, then the different 
broadcast stream will be tuned, the different transport stream will 
be extracted from the different broadcast stream and the 
appropriate video stream will be decoded and presented. 

Similarly, a user interaction resulting in a prior time interval 
10 or a different set of channels (i.e., a group of channels) will result in 
the retrieval and presentation of an appropriate video stream. It is 
important to note that each extracted video stream is associated 
with a common audio stream. Thus, the video/audio barker 
function of the program guide is continuously provided, regardless 
15 of the selected video stream. 

The above described user manipulations, and the resulting 
change in presented video streams, are all within the same 
"context" of the program guide. That is, the context of the program 
guide (i.e., the contextual model) described thus far is the "program 
20 guide" context in which user manipulations to the guide are used to 
modify the attributes of the program grid. In the event of a user 
selection of a highlighted or emphasized program within the 
program grid, the context changes to a "program selected" context, 
in which the video and audio information streams associated with a 
25 selected channel are retrieved and presented to the user. The 
selection information is coupled to the head end via the back 
channel. The head end then couples the appropriate streams to the 
user, if they are not already being received by the user. In the 
program selection context, the user may have selected a broadcast 
30 stream (i.e., a network feed), a narrowcast stream (a regional or 
local information feed, such as a community or public access 
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channel) or a pointcast stream (such as a pay per view event or 
interactive shopping channel). 

After the user has finished viewing or otherwise utilizing a 
selected program, the operating context of the STT/program guide 
5 will return to the program guide context. That is, any pointcast or 
narrowcast "session" that was initiated due to the selection of a 
program will be torn down upon completion of that program. The 
user will be returned to the broadcast streams associated with the 
program guide of the present invention. The concept of contextual 

10 shifting and the implications for bandwidth utilization described in 
more detail below. Briefly, the invention operates to maximally 
utilize the bandwidth within an interactive information 
distribution system by allocating system functionality to system 
components (i.e., server side and subscriber side) such that a 

15 common interactive program guide may be provided by the head 
end to multiple subscribers via a broadcast (i.e., non-specific 
subscriber delivery) technique, which requires less expensive 
transmission techniques than those used for pointcast (i.e., 
subscriber specific delivery) transmission techniques. 

20 FIG. 2 depicts subscriber side equipment suitable for use in 

the present invention. Specifically, FIG. 2 depicts a set top terminal 
(STT) comprising a tuner 210, a demodulator 220, a transport 
demultiplexer 230, an audio decoder 240, a video decoder 250, an on 
screen display processor (OSD) 260, a frame store memory 262, a 

25 compositor 290 and a controller 270. User interaction is effected via 
a remote control unit 280. Tuner 210 receives, e.g., a radio 
frequency (RF) signal comprising a plurality of quadrature 
amplitude modulated (QAM) information signals from a forward 
channel such as a hybrid fiber optic cable television system. Tuner 

30 210, in response to a control signal TUNE, tunes to a particular one 
of the QAM information signals to produce an intermediate 
frequency (IF) information signal. Demodulator 220 receives and 
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demodulates the intermediate frequency QAM information signal to 
produce an information stream, illustratively an MPEG transport 
stream. The MPEG transport stream is coupled to a transport 
stream demultiplexer 230. 
5 Transport stream demultiplexer 230, in response to a control 

signal TD produced by controller 270, demultiplexes (i.e., extracts) 
an audio information stream AE and a video information stream 
VE. The audio information stream AE is coupled to audio decoder 
240, which decodes the audio information stream and presents the 
10 decoded audio information stream AD to an audio processor (not 
shown) for subsequent presentation. The video stream VE is 
coupled to the video decoder 250, which decodes the compressed 
video stream VE to produce an uncompressed video stream VD that 
is coupled to the compositor 290. OSD 260, in response to a control 
15 signal OSD produced by controller 270, produces a graphical 
overlay signal VOSD that is coupled to the compositor 290. 

Optionally (e.g., in the absence of a default or predetermined 
overlay design), transport stream demultiplexer 230 retrieves a 
data stream DATA, illustratively an auxiliary data stream or user 
20 data stream according to, e.g., the MPEG standards. The retrieved 
data stream DATA provides information regarding overlay 
parameters and other program guide information. The retrieved 
data stream may also include other profile parameters inserted into 
the forward channel bitstreams by a profile unit 460 of FIG. 4 
25 (described below). 

Additionally, in one embodiment, the data stream identifies 
sequence header location, GOP structure, coding parameters, PID 
locations, program map tables and other information suitable for 
use by controller 270 in, e.g., selecting appropriate decoding or 
30 processing parameters. 

The compositor 290 merges the graphical overlay signal VOSD 
and the uncompressed video stream VD to produce a modified 
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video stream (i.e., the underlying video images with the graphical 
overlay) that is coupled to the frame store unit 262. The frame store 
unit 262 stores the modified video stream on a frame-by-picture 
basis according to the frame rate of the video stream. Frame store 
5 unit 262 provides the stored video frames to a video processor (not 
shown) for subsequent processing and presentation on a display 
device. The frame store unit 262, in response to a control signal F 
produced by the controller 270, "freezes" in memory (i.e., does not 
update) a presently stored video frame such that the video 

10 information provided to the video process results in a still image. 
This is useful when, e.g., a broadcast program guide utilizes 
scrolling information, a telephone number or address is briefly 
displayed or a user simply wants to view a presently displayed 
frame for a longer period of time. 

15 Controller 270 comprises a microprocessor 272, an 

input/output module 274, a memory module 276, an infrared (IR) 
receiver 275 and support circuitry 278. The microprocessor 272 
cooperates with conventional support circuitry 278 such as power 
supplies, clock circuits, cache memory and the like as well as 

20 circuits that assist in executing the software routines. The 
input/output circuitry 274 forms an interface between the 
controller 270 and the tuner 210, the transport demultiplexer 230, 
the onscreen display unit 260, the back channel modulator 295, and 
the remote control unit 280. Although the controller 270 is depicted 

25 as a general-purpose computer that is programmed to perform 
specific interactive program electronic guide control function in 
accordance with the present invention, the invention can be 
implemented in hardware as an application specific integrated 
circuit (ASIC). As such, the process steps described herein are 

30 intended to be broadly interpreted as being equivalently performed 
by software, hardware, or a combination thereof. 
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In the exemplary embodiment of FIG. 2, the remote control 
unit 280 comprises an 8-position joystick, a numeric pad, a "select" 
key, a "freeze" key and a "return" key. User manipulations of the 
joystick or keys of the remote control device are transmitted to a 
controller via an infrared (IR) link. The controller 270 is responsive 
to such user manipulations at several levels of abstraction. 
Specifically, the controller interprets user manipulations as 
interaction model manipulations or interface model manipulations, 
which are described below. 

Interaction model manipulations are those manipulations 
which depend only upon local processing resources, such as 
changing overlay object emphasis or selecting a new video stream 
within a previously tuned and demodulated transport stream (i.e., a 
sub-stream having only a different packet id (PID) than the 
presently displayed sub-stream or tuning to another channel 
already present in the broadcast spectrum). Interface model 
manipulations are those manipulations which require interaction 
with the head end, such as selection of an object that requires a 
change from a broadcast mode of operation to a pointcast mode of 
operation. These modes will be described in more detail below. 
Briefly, in a broadcast mode of operation, many subscribers receive 
and utilize the same information stream. In a pointcast mode of 
operation, only one subscriber receives and utilizes a particular 
information stream. In a narrowcast mode, a relatively small 
number of subscribers receives and utilize a particular information 
stream. This is, essentially, a "shared pointcast" mode. 

Referring to FIG. 1, emphasis and selection of promotional 
splash 110 changes the context from the program guide context to a 
shopping guide context. Within the shopping guide context the 
user is allocated an individual interactive information stream (i.e., 
a pointcast stream) allowing the user to buy a particular product, 
browse a particular group of products or otherwise interact with 
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the server. Similarly, selection of the logo object 115 or any of the 
channel objects 135 or channel number objects 130 results in a 
narrowcast information stream that provides the user with general 
information associated with the companies or individuals 
5 identified with the logos or channel boxes. Within a narrowcast 
context just described, a user may change to a pointcast context to 
retrieve more particularized information. Similarly, if the user 
emphasizes and selects the video barker object 120 a new stream is 
provided to the user in which the video barker may be displayed at 
10 full screen resolution or a promotional screen other than the video 
barker may be displayed. Optionally, ordering information for a 
pay preview event represented by the video barker may also be 
provided. Scrolling promotional banner 155 may also be selected, 
bringing the user to a narrowcast or broadcast stream that 
15 provides a promotional video barker or other information. It 
should be noted that the time of day information and date 
information 105 may be retrieved by the subscriber and utilized to 
synchronize the clock within the subscriber terminal. 

The interactive program guide 100 depicted in FIG. 1 is 
20 formed using a single video stream having an associated audio 
stream and a corresponding graphic overlay. The program guide 
display 100 depicts an hour and a half time interval for each often 
channels. Thus, to depict an entire 24-hour time interval for ten 
channels, it is necessary to provide 16 separate images or display 
25 screens of information. 

Each particular video screen may be associated with a packet ID 
(PID) value. A plurality of such video streams may be included 
within a single transport stream. 

FIG. 3 depicts a flow diagram of a user interaction routine 300 
30 suitable for use in the subscriber side of equipment of FIG. 2, and 
more particularly, suitable for use in the controller 270 of the 
subscriber side equipment depicted in FIG. 2. The routine 300 is 
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entered at step 302, when the subscriber side equipment is powered 
on. The routine 300 then proceeds to step 304, where a first or 
default broadcast stream from the forward channel is tuned by RF 
tuner 210 in response to a control signal TUNE provided by 
5 controller 270. The tuned broadcast stream, illustratively BS1, is 
demodulated by demodulator 220 to produce one or more transport 
streams which are coupled to transport stream demultiplexer 230. 
A video stream having a default packet ID (PID) and an audio 
stream having a default packet ID (PID) are demultiplexed by 
10 transport stream demultiplexer 230 to produce an encoded audio 
stream AE and an encoded video stream VE. 

After tuning the first broadcast stream and demultiplexing 
the first video stream and associated audio stream (step 304), the 
routine 300 proceeds to step 306, where an appropriate overlay is 
15 retrieved from memory unit 276. That is, a default overlay, e.g., an 
overlay stored in static overlay storage unit 276-1 in a memory unit 
276, is retrieved by the controller 270 and coupled to the OSD 
generator 260. Optionally, as previously discussed, transport 
demultiplexer 230 also demultiplexes a control and applet data 
20 stream, illustratively an auxiliary data stream included with the 
signal received via a forward channel. This data stream may 
include specific overlay information intended to be used with the 
received program stream and stored in the dynamic overlay storage 
unit 276-2. Alternatively, the received data stream may include 
25 simply X-Y grid coordinates that may be used to calculate an 

appropriate overlay for the video stream. The overlay information 
may simply be default information suitable for use in a fixed (i.e., 
predetermined) on screen program guide display. Upon retrieving 
the appropriate overlay, the routine 300 proceeds to step 308. 
30 At step 308, routine 300 presents the merged overlay and 

video information stream. That is, the decoded video stream VD 
produced by video decoder 250 and the on-screen display stream 
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VOSD produced by OSD unit 260 are merged together by 
compositor 290 to produce a merged video stream which is then 
coupled to a video processor (not shown) for further processing 
prior to presentation on a display device. Contemporaneously, 
audio decoder 240 is decoding the appropriate audio channel, i.e., 
the audio information stream associated with the audio PID of step 
304, which is then coupled to an audio processor for subsequent 
presentation by a set of speakers. The routine 300 then proceeds to 
step 310, where it waits for a user command. Upon receipt of a user 
command, such as the receipt of a joy stick manipulation indicative 
of an on-screen program guide command such as a change in object 
emphasis or a selection of an object or other related commands, the 
routine proceeds to step 312, where the received user command is 
evaluated. 

After evaluation the received user command (step 312) the 
routine 300 proceeds to step 314, where a query is made as to 
whether the received command requires processing at an 
interactivity model level only. That is, whether the received 
command is simply directed towards changing the on screen object 
presently emphasized (interactivity model only or set top terminal 
processing only), or directed towards retrieving information found 
in a different video stream. For example, a non interactivity model 
command includes commands that change the contents of the 
program grid 150 (different group of channels or different 
displayed time intervals), commands that indicate a selection of an 
emphasized object (i.e., selection of a promotional banner or object, 
selection of a channel, increment or decrement of the presently 
displayed group of channels such that a different video stream is 
required, increment or decrement of the displayed temporal 
intervals such that a different video stream is required, and so on. 

If the query in step 314 is answered affirmatively, then the 
routine 300 proceeds to step 316, where the overlay is modified. 
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That is, the presently emphasized object is de-emphasized by the 
on-screen display unit 260 and emphasis is placed on a different 
object- For example, referring to the electronic program guide 
display 100 of FIG. 1, if the promotional object 110 is presently 
5 highlighted, and the user moves the joy stick in a manner 

indicating an intent to select the logo object 115 (e.g., an upper 
right movement of the joy stick), then the overlay is modified by de- 
emphasizing object 110 and emphasizing object 115. The routine 
300 then proceeds to step 308, where the audio and merged overlay 

10 and video information are presented. 

If the query at step 314 is answered negatively, then the 
routine proceeds to step 318, where a query is made as to whether a 
time-dependent stream is being selected. That is, if the query at 
step 314 is answered negatively, then the received command is such 

15 that an additional video information stream is to be selected. At 
step 318 a query is made as to whether that additional video 
information stream to be selected is one of a time-dependent stream 
or a time- independent stream. A time-dependent stream is a 
stream that is either broadcast or narrowcast to a plurality of 

20 subscribers. That is, a time-dependent stream is a stream received 
by many subscribers such that no one subscriber may control the 
transmission of that stream. A time-independent stream comprises, 
e.g., a pointcast stream such as an interactive shopping channel, a 
pay per view channel and the like. 

25 If the query at step 318 is answered negatively, the routine 

300 proceeds to step 320, where a pointcast stream acquisition is 
initiated. That is, at step 320, the process of initiating a pointcast 
session is started by transmitting appropriate information to the 
server side via the back channel. The routine 300 then proceeds to 

30 step 322, where the appropriate pointcast stream is tuned. The 
routine 300 then proceeds to step 328, where the video and audio 
stream (i.e., the PID associated with video and the PID associated 
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with audio) streams are demultiplexed by transport demultiplexer 
230. The routine 300 then proceeds to step 330, where an 
appropriate overlay is retrieved, and to step 308, where the audio 
and video merged with overlay streams are presented. In the case 
5 of a pay per view presentation, the overlay may comprise a 
transparent overlay, such that there is no on-screen display 
associated with a pay per view presentation. Optionally, the 
overlay may comprise a small icon or logo to indicate which pay per 
view channel or which cable channel has been selected for 

10 processing. 

If the query at step 318 is answered affirmatively, then the 
routine proceeds to step 324, where any existing 
narrowcast/pointcast session is torn down, and to step 326, where 
the last broadcast stream tuned by the subscriber side equipment is 

15 re-tuned, and the associated transport stream or streams are re- 
acquired. In this manner, in the event of a user selecting a 
particular pay per view or other context-changing program, the 
context will be returned to the initial program guide context upon 
exiting the changed-to context (i.e., time independent stream). The 

20 routine 300 then proceeds to step 328, where the video and 
associated audio streams are multiplexed according to the 
appropriate PID values. The routine 300 then proceeds to step 330, 
where the appropriate overlay is retrieved (e.g., the program guide 
object oriented emphasis overlay), and to step 308, where the audio 

25 and merged overlay and video streams are presented. 

The above described user interaction routine 300 provides an 
efficient method for user navigation within an interactive 
information distribution system. Specifically, the user manipulates 
on screen objects by selectively emphasizing or de-emphasizing 

30 those objects using a remote control device associated with the set 
top terminal. Within the program guide context objects are 
emphasized and de-emphasized and selected to retrieve desired 
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video and/or audio streams. For example, in the case of the on 
screen display 100 of FIG. 1, a user may manipulate any of the 
objects and select a particular object to change the context of the 
program guide such that the user changes the level of abstraction 
5 (i.e., context) by which information is presented. 

FIG. 4 depicts a high-level block diagram of an interactive 
information distribution system. Specifically, FIG. 4 depicts an 
interactive video information distribution system directed towards 
providing a plurality of video information streams and an 
10 associated audio information stream suitable for use in the 

interactive electronic program guide described above with respect 
to FIG. 1. 

The head end processing portion 400 depicted in FIG. 4 
comprises an audio source 410A, a plurality of video sources 410V1 

15 through 410VN, an audio encoder 420A, a plurality of video 
encoders 420V1 through 420VN, a plurality of transport 
multiplexers 430-1 through 430-N, a plurality of intermediate 
frequency (IF) modulators 440-1 through 440-N, a radio frequency 
(RF) modulator 450, a video profile module 460, a file server 470, a 

20 clock source 405, an RF demodulator 480. 

Audio source 410A provides an audio information stream, 
illustratively an audio information stream associated with the 
audio-visual barker 120 of the interactive program guide display 
100 of FIG. 1. The audio information stream is coupled to an audio 

25 encoder 420A, where it is encoded into a standard compressed 
audio format, such as Dolby AC3 or another appropriate format. 
The encoded audio stream A is coupled to each of the transport 
multiplexer units 430-1 through 430-N. 

The first video source 410V1 provides, illustratively, 16 video 

30 information streams to video encoder 420V1. Each of the 16 video 
streams is suitable for providing the video information necessary to 
support the interactive program guide display 100 of FIG. 1. 
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Specifically, it is noted that in the exemplary program guide 100 of 
FIG. 1 up to ten channels may be displayed at one time. Thus, each 
of the video information streams includes information sufficient to 
display a program guide screen comprising a 10-channel group of 
5 channels. In one embodiment of the invention, each of the 16 video 
streams coupled to the video encoder 420 comprises information 
sufficient to provide all video layer information for a single channel 
group, e.g., channels 1-10. In the case of only one of the 16 video 
streams being used, the output of the video encoder 420 comprises a 
10 single encoded video stream (which will be subsequently included 
in a single transport stream). In the case of more than one of the 16 
video streams being used, the output of the video encoder 420 
comprises more than one (up to 16) encoded video stream (all of 
which will be subsequently included in a single transport stream). 
15 It will be noted that 16 video streams represents 24 hours of 
programming for a single channel group in the case of 1.5 hour 
program groupings. 

All the generated streams are temporally aligned in terms of 
data (i.e., streams depicting different channels or different times 
20 are aligned such that stream to stream switching at a decoder may 
be accomplished in a substantially seamless manner). In addition, 
the streams are generated in a synchronized manner with respect 
to clock source 405, such that GOP structures, sequence headers, I- 
picture location and other parameters (which are indicated via the 
25 profile unit 460) are (if desired) aligned across a plurality of 
information streams. In this manner, stream splicing may be 
performed without noticeable video artifacts or audio artifacts, and 
without excessive latency. 

A database 402 provides program guide information to a 
30 plurality of video sources 410V1 through 410VN. Each of the 

plurality of video sources 410V1 through 410VN is associated with, 
illustratively, ten channels (i.e., AMC, Fox, HBO and the like). Each 



DIVA 070CON1 



-21- 



of the ten channels provides different programming material at 
different times of the day as denoted by programming grid 150 in 
the interactive electronic program guide display 100 of FIG. 1. 
Specifically, since the displayed portion of the programming grid 
5 150 comprises a 1.5 hour time interval, it is necessary to associate 
16 (25 divided by 1.5) video streams with each ten-channel block for 
each 24 hour period. That is, a first of the 16 video streams 
associated with the ten channel block is used to identify 
programming material from 12:00 a.m. through 1:30 a.m., a second 
10 stream is used to identify programming material from 1:30 a.m. 
through 3:00 a.m. and so on. Thus, video source 1 (410V1) provides 
16 video information streams to video encoder 1 (420V1), wherein 
each of the 16 video information streams includes program 
identification information for channels 1-10 for each of the 16 1.5 
15 hour time intervals. That is, each of the 16 video streams is capable 
of providing the video layer used in electronic program guide 
display 100 of FIG. 1 for a respective 1.5 hour time period. 

Included within the program guide display 100 is, of course, 
the video barker 120. Associated with the video barker 120 is the 
20 audio stream A produced by audio source 410A and encoded by 
audio encoder 420A. The 16 video streams produced by video 
encoder 420V1, the audio stream produced by audio encoder 420A 
and a reference clock CL produced by a clock source 405 are 
coupled to a first transport multiplexer 430-1. Similarly, 16 video 
25 information streams representing 24 hours of programming data 
for channels 11 though 20 are produced by a second video source 
410V2, and coupled to a second video encoder 420V2. The 16 
encoded video streams V2 produced by second video encoder 420V2 
are coupled to a second transport multiplexer 430-2 along with the 
30 audio stream A and clock signal CL. Similarly, the Nth video source 
410VN produces 16 video information streams associated with a 24- 
hour programming period for the N-9 through Nth channels in the 
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system. The 16 video information streams produced by the Nth 
video stream 410VN are coupled to an Nth video encoder 420VN 
where they are encoded. The Nth group of 16 encoded video 
information streams VN is then coupled to an Nth transport 
5 multiplexer 430-N, along with the audio stream A produced by 
audio encoder 420A and the clock signal CL produced by clock 
source 405. 

Each of the transport multiplexers 430-1 through 430-N 
produces a respective output transport stream Tl through TN that 
10 is coupled to a respective intermediate frequency (IF) modulator 

■Hi 

440-1 through 440-N. Optionally, the transport streams Tl through 
TN are coupled to file server 470 for storage prior to subsequent 
delivery to the respective IF modulators 440-1 through 440-N. The 
IF modulators 440-1 through 440-N produce respective IF output 
15 signals which are then coupled to RF modulator 450. The RF 

modulator 450 modulates the respective IF signals onto a carrier 
frequency for subsequent transmission via a forward channel. 

It is important to note that, while the transport multiplexing 
function is depicted as being performed by a plurality of transport 
20 multiplexers 430-1 through 430-N, the transport multiplexing 
function may also be performed using a single transport 
multiplexer. Additionally, while the IF modulation function is 
depicted as being performed by a plurality of IF modulators 440-1 
through 440-N, the IF modulation function may also be performed 
25 using a single IF modulator. The main constraint placed upon the 
IF modulation function relates to the available bandwidth within 
the forward channel FC. That is, since each IF modulated signal 
IF1 through IF-N is capable of carrying data at a maximum bitrate 
(e.g., 27Mbps in a 64 QAM modulation scheme), the total data rate of 
30 the transport stream(s) within the IF modulated signal cannot 
exceed the available bandwidth. Thus, in the case very high data 
rate streams are transport encoded, it may be necessary to use 
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several IF modulators to produce several corresponding IF 
modulated signals for transmission via the forward channel FC. 

A control and applet source 410D provides control 
information and applet data information (i.e., subscriber side 
5 programs provided by the server) to a packetizer 420D, 

illustratively an MPEG2 packetizer producing an auxiliary data 
stream DATA. The auxiliary data stream DATA is coupled to RF 
modulator 450 and, optionally, each of the transport multiplexers 
430-1 through 430-N. In the case of the auxiliary data stream DATA 
10 being coupled to each of the transport multiplexers, the resulting 
multiplexed transport streams Tl through TN will each include the 
control and applet data such that retrieval of any one of the 
multiplexed transport streams from the forward channel by a set 
top terminal will yield control data and applet data sufficient to 
15 run any appropriate subscriber side programs. 

The RF modulated data is coupled to a forward channel 
within, e.g., a cable television system or other information 
distribution system. The information distribution system is 
denoted as data pipe DP and is coupled to a plurality of 
20 neighborhood information distribution systems 490-1 through 490-3. 
Each of the neighborhood distribution systems 490-1 through 490-3 
is coupled to a plurality of set top terminals 200. It should be noted 
that while each of the set top terminals is denoted by the same 
reference designator (i.e., 200), each of these terminals will be 
25 associated with a unique terminal identification (TID) and other 
subscriber specific information. The set top terminal 200 described 
above with respect to FIG. 2 may be used within the system of FIG. 
4. Furthermore, each set top terminal is associated with a display 
device (i.e., a television or other display device) and an audio 
30 presentation unit (i.e., speakers and associated speaker drivers). 
The display device and speakers are denoted by the DISP, L and R 
designators. 
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FIG. 5 depicts a user interaction routine 500 according to the 
invention. The routine 500 is entered at step 502, when subscriber 
side equipment is initially powered on or otherwise initialized. The 
routine 500 then proceeds to step 504, where a first default stream 
5 is tuned and demodulated. The routine 500 then proceeds to step 
506, where a default video stream and associated audio stream is 
demultiplexed and displayed or presented. The routine 500 then 
proceeds to step 508, where an appropriate overlay is retrieved and 
displayed along with the displayed or presented video stream. The 
10 routine 500 then proceeds to step 510, where the processor waits for 
user input via, e.g., remote control device 280. 

Upon receipt of user input, the routine proceeds to step 512, 
where the user input is evaluated. The routine 500 then proceeds 
to step 514, where a query is made as to whether the evaluation 
15 indicates that the abstraction level indicated by the user input is a 
contextual or local interactivity. 

If the query at step 514 indicates that the user interaction is 
such that the contextual level of the interactive experience is to be 
changed, then the routine proceeds to step 516. At step 516, a query 
20 is made as to which key has been pressed by the user. If the query 
at step 516 indicates that the "return" key has been pressed, then 
the routine 500 proceeds to step 518, where the previous context is 
re-acquired. That is, in the case of a present pointcast context such 
as an interactive shopping or pay per view context, activation of a 
25 "return" key on the remote control device indicates that a return to 
the previous context is required, which would typically mean that 
return to the program guide context is desired. The routine 500 
then proceeds to step 510, where the processor waits for user input. 
If the query at step 516 indicates that the key pressed was the 
30 "select" key, then the routine proceeds to step 520, where the 

context is changed in response to the emphasized object selected by 
the "select" key. The routine 500 then proceeds to step 522, where 
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the selected context function or functions are performed. The 
routine then proceeds to step 510, where the processor waits for 
user input. 

If the query at step 514 indicates that local interactivity only 
5 is requested by the user, then the routine proceeds to step 524, 
where a query is made as to the type of key pressed by the user. If 
the query at step 524 indicates that the "freeze" key has been 
pressed by the user, then the routine proceeds to step 534, where 
the video frame presently stored in frame store unit 262 is frozen. 
10 That is, the frame store unit 262 is not updated by subsequent video 
frames until such time as the "freeze" key or other key is pressed 
again. The routine 500 then proceeds to step 510, where the 
processor waits for user input. If the query at step 524 indicates 
that an "increment" key has been pressed (e.g., a temporal 
15 increment or channel increment) then the routine proceeds to step 
532. 

At step 532 a query is made as to whether the presently 
selected video stream, as indicated by the PID of the stream, is, in 
fact, the last video stream within a particular broadcast stream If 
20 the query at step 532 is answered affirmatively, then the routine 
500 proceeds to step 538, where the next broadcast stream is tuned. 
The routine 500 then proceeds to step 506, where the first video and 
associated audio streams of the newly tuned broadcast stream are 
demultiplexed and displayed or presented. 
25 If the query at step 532 is answered negatively, then the 

routine 500 then proceeds to step 536, where the next video stream 
(i.e., the next video PID) is demultiplexed and displayed. The 
routine 500 then proceeds to step 510, where the processor waits for 
user input. 

30 If the query at step 524 indicates that a "decrement" key was 

pressed (i.e., a temporal or channel identification decrement), then 
the routine 500 proceeds to step 526, where a query is made as to 
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whether the presently selected video stream as indicated by the 
PID of the stream is, in fact, the first video stream in the presently 
tuned broadcast stream. If the query at step 526 is answered 
affirmatively, then the routine 500 proceeds to step 528, where the 
5 previous broadcast stream associated with the "decrement" key (i.e., 
the previous broadcast stream including the temporal and/or 
channel information) is tuned. The routine 500 then proceeds to 
step 506. If the query at step 520 is answered negatively, then the 
previous video stream associated with the appropriate parameter 
10 (i.e., temporal or channel parameter) is demultiplexed and 

displayed along with the associated overlay. The routine 500 then 
proceeds to step 510, where the processor waits for user input. 

A critical aspect of the present invention is the isolation of 
the interaction model at the set-top box level, where no context is 
15 associated with any user interaction, and where merely the 

manipulation of audio and visual elements represents the applying, 
removing, and shifting of emphasis from one area of the display 
screen to another. All items containing contextual information 
reside in a centralized location where they are processed and the 
20 management of network resources executed in manner to enable 
the context-based service request or transition. 

This invention works by combining the use of broadcast 
digital video streams with video-on-demand streams to produce a 
compelling user interface in both visual and audio terms. The 
25 invention uses an intelligent set top box's ability to manipulate a 
graphics overlay plane displayed in conjunction with a video box. 
The system allows the interactions to carry the user from broadcast 
(or narrowcast) video stream to broadcast (or narrowcast) video 
stream, from broadcast (or narrowcast) video stream to pointcast 
30 video stream, and from pointcast video stream to broadcast (or 
narrowcast) video stream. 



DIVA 070CON1 



-27- 



At the heart of the interactive program guide is a method that 
takes the time-dependent information and provides that 
information in streaming mode over a series of synchronized real- 
time video streams. The user of the guide agilely moves between 

5 these broadcast streams to receive the full set of available listings. 
When the user's interest takes him/her from the domain of time- 
dependent information, such as a listing of currently available 
programming to the realm of time-independent information, such 
as previews, promotions and the like, the streams processed at the 

10 set top box transition from broadcast to pointcast (on-demand) 
streams. 

When the user's interest takes him/her from one area of time- 
independent information back to an area of time-dependent 
information, the streams requested by the system and processed at 
15 the set top box will shift from one pointcast stream to a broadcast 
stream. For example, when a user returns to the program guide 
from an interactive shopping channel or pay per view event the 
video stream served to the user changes from a pointcast stream to 
a broadcast stream. That is, the pointcast session is torn down and 
20 the user's STT selects the appropriate broadcast stream. 

The user of the exemplary interactive program guide controls 
the logical operation of shifting the emphasis from one "object" to 
the next through the use of an interactive device such as a remote 
control with directional arrows, a joystick or other interactive 
25 controller. Such an approach may be used with or without an on- 
screen pointer or cursor. When the user makes a selection to a 
single option, the tuner 210 in the set top box may be force-tuned to 
the corresponding selection. 

Traversal of the available options in a long list of 
30 programming options is achieved by providing the option to page 
through the various sets of options. This effect is achieved by 
jumping from one video stream (by changing from one PID to 
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another within the same or different QAM channel). The advantage 
of jumping within the same QAM channel is that there will not be 
any noticeable added latency associated with tuning and 
demodulating a new QAM channel. 
5 It is important to note that synchronization of program 

channel numbers with areas of on-screen emphasis is achieved 
through either in-band data delivery, out-of-band data delivery, 
vertical blanking interval (VBI) data delivery or other approaches 
known to those familiar in the art of data delivery in broadband 
10 networks. That is, data indicative of the location of manipulable 
screen objects (i.e., those objects that may be selectively 
emphasized) is provided to the set top terminal via one or more 
techniques. 

Channel options in the Interactive Program Guide can 
15 represent any combination of programming offered from a wide 
range of sources, including but not limited to, over-the-air 
broadcast, cable broadcast, satellite broadcast, local programming, 
ad insertion apparatus and can include the full range of pay 
channels, pay per view (PPV), video on demand (VOD), near video 
20 on demand (NVOD), internet service, interactive gaming, 

interactive shopping, "free" programming, etc. Channel numbers 
can be virtual in nature, and they can be remapped in either the set 
top box or the head end equipment to correspond to the service 
being delivered. 

25 Delivery of PPV, NVOD, VOD, interactive gaming, interactive 

shopping, internet, video classified ads, and other services can be 
integrated into this system in a two-way cable environment 
through the use of cable modem technologies or other back-channel 
methods known to those familiar in the art of enabling such 

30 services in a network environment. 

This invention may further be used to enable pay television 
services, such as subscription services like HBO®, Showtime®, etc., 
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in a two-way cable environment through the use of cable modem 
technologies or other back-channel methods known to those 
familiar in the art of enabling such services in a network 
environment, 

5 This system can further be extended to implement conditional 

access by arranging bitmap information in different data blocks 
according to types of access allowed. Processing of this information 
is done at the head end where a series of descriptors are developed 
for each on-screen area capable of receiving emphasis. Part of the 
10 descriptors contains entitlement "locks" mapping access 

entitlement to on-screen areas capable of displaying emphasis. At 
the set top box, a series of "keys" exist that map to those channels 
the user is entitled to view. If one of the keys "fits" any of the locks, 
the bitmap set linked to the key may receive on-screen emphasis at 
15 the set top box. 

The invention is unique because, advantageously, it does not 
require the maintenance of television programming lists in the set 
top box, it adds a level of interactivity to current broadcast 
programming guides, it provides a more television-like user 
20 experience, and it makes the best economic use of bandwidth in 
intricate, asset-rich interactive program guides. 

In one embodiment of the invention, multiplexed broadcast 
analog or digital video and static, pre-programmed bitmaps are 
utilized. In this embodiment, the pre-programmed bitmaps are 
25 installed in the set top box in, e.g., memory module 276. The 

bitmaps are x-y grid borders that align with x-y grid borders built 
into the broadcast video streams, and are modified in color and/or 
degree of transparency to allow visual emphasis to be associated 
with a single option or set of options. 
30 In another embodiment of the invention, multiplexed 

broadcast analog or digital video and dynamic, pre-programmed 
bitmaps are utilized. In this embodiment, a variety of pre- 
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programmed bitmaps are installed in the set top box. These 
bitmaps may be x-y grid borders, circles, or any other delineator 
capable of providing adequate emphasis so that a user may discern 
the option of set of options representing an actionable field. These 
5 may align with borders built into the broadcast video streams and 
are modified in color and/or degree of transparency to allow visual 
emphasis to be associated with a single option or set of options. 
The set top box can move back and forth between one set of 
bitmaps and another. 
10 Synchronization of a particular set of installed bitmaps to a 

broadcast video stream is achieved through signaling linked to the 
broadcast video stream either through in-band data delivery, out- 
of-band data delivery, vertical blanking interval data delivery or 
other approaches known to those familiar in the art of data 
15 delivery in broadband networks. 

In another embodiment of the invention, multiplexed 
broadcast analog or digital video and dynamic, updateable bitmaps 
are used. In this embodiment, a variety of pre-programmed 
bitmaps may or may not be installed in the set top box. As in the 
20 previous embodiment, these bitmaps may be x-y grid borders, 
circles, or any other delineator capable of providing adequate 
emphasis so that a user may discern the option of set or options 
representing an actionable field. These may align with borders 
built into the broadcast video streams and are modified in color 
25 and/or degree of transparency to allow visual emphasis to be 

associated with a single option or set of options. The set top box 
can move back and forth between one set of bitmaps and another. 
Synchronization of a particular set of installed bitmaps to a 
broadcast video stream and download of new bitmaps is achieved 
30 through signaling linked to the broadcast video stream either 

through in-band data delivery, out-of-band data delivery, vertical 
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blanking interval data delivery or other approaches known to those 
familiar in the art of data delivery in broadband networks. 

In one embodiment of the invention a set top box focused 
method is described for transitioning from stream to stream 
5 without interruption in signal or contextual continuity with 
parallel information streams in an interactive information on 
demand environment. Specifically, referring to FIG. 4, a high-level 
block diagram depicting the formation and distribution of a 
plurality of related information streams is shown. Specifically, the 
10 related information streams comprise a single audio information 
stream and a plurality of video information streams. Each video 
information stream comprises image information such as the image 
information depicted in the interactive electronic program guide 
display 100 of FIG. 1. However, each video stream is associated 
15 with different channels as identified in the channel grid 150, 

channel identification 135 and channel number 130 objects in the 
display 100 of FIG. 1. 

In one embodiment of the invention, text information is 
integrated into video streams to provide a video-based, remote cast 
20 interactive program guide. That is, text information is included 
within the downstream video portion as part of the onscreen 
program guide. This text information may comprise, e.g., stock 
quotes and other information. 

In another embodiment of the invention, profiling data is 
25 produced by transport demultiplexer 230. Specifically, transport 
demultiplexer 230 produces data indicative of GOP structure, 
sequence header locations, I-picture locations, PID identifications, 
and other information included in the broadcast streams and/or 
video and audio streams included within that broadcast stream. 
30 In another embodiment of the invention, a system and method 

for advertisement insertion into pointcast and narrowcast digital 
distribution systems is disclosed. Specifically, advertisements 
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appropriate to a particular subscriber or a group of subscribers in, 
e.g., a neighborhood, are inserted into pointcast or narrowcast 
digital video streams going to that subscriber or neighborhood of 
subscribers. 

5 In another embodiment of the invention, a system and method 

for invoking an information stream using a video-based, remote- 
cast interactive program guide in an interactive information-on- 
demand system is disclosed. 

In another embodiment of the invention, a method and 
10 apparatus for processing conditional access information for a 
video-based, remote cast interactive program guide is disclosed. 
Also disclosed is a method and apparatus for merging multiple 
sources of scheduled and on-demand programming for a video- 
based, remote cast interactive programming guide. Additionally 
15 disclosed is a system and method for inserting advertisements into 
an interactive program guide based on user profiles (i.e., 
demographic profiles). These demographic profiles are also useful 
in targeting, in either pointcast or narrowcast streams, advertising 
material for a particular subscriber or a group of subscribers. Also 
20 disclosed is a method and apparatus for blending sub-elements of 
independent MPEG streams to make a single unified MPEG stream 
(also known as slice level splicing). In this embodiment, particular 
elements of the onscreen program display are associated with 
particular slices. That is, a slice comprises one or more contiguous 
25 blocks within a single row of macroblocks. The first block of a line 
is always the first block of a slice, the last block of a line is always 
the last block of a slice. A line may comprise a single slice or 
multiple slices. By forming the onscreen display according to a 
slice-based regional approach, slice level splicing may be performed 
30 at a subscriber end by, e.g., controller 270 adaptively coupling slices 
from one or more information streams to an output. 
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Also disclosed is a method and apparatus for the generation 
of rewind tracks for MPEG in near real time. That is, the head end 
processing system may include, in addition to standard (i.e., 
forward) video information streams, additional information 
5 streams comprising a temporally reversed information stream. 
This temporally reversed information stream need not be 
transmitted contemporaneous to the forward information stream. 
Rather, portions of the rewind information stream may be 
transmitted such that a slicing operation between the streams may 
10 result in a stream switching without excessive latency, while at the 
same time the rewind track is acquired rapidly and provided to the 
output. 

FIG. 6 depicts a display screen of an interactive electronic 
program guide (IEPG). Specifically, FIG. 6 depicts an exemplary 

15 interactive electronic program guide display 600 that is formed and 
operates in a manner similar to that described above with respect 
to the IEPG display 100 of FIG. 1. That is, the interactive program 
guide display 600 of FIG. 6 utilizes a video layer and a graphics 
layer that is displayed on, e.g., a television screen or other video 

20 presentation device in, e.g., the home of a subscriber to a cable 
television system or other information distribution system. Video 
information representative of each of a plurality of IEPG objects or 
elements is generated at the cable television central processing end 
or the head end and transmitted as part of a video stream. Graphic 

25 layer objects are associated with at least those video layer objects 
that may be manipulated by user interaction via, e.g., a remote 
control device. Subscriber side equipment suitable for receiving 
and displaying the IEPG is described above with respect to FIG. 2. 
The primary differences between the IEPG displays of FIG. 1 

30 and FIG. 6 are as follows. First, the IEPG display 100 of FIG. 1 
utilizes a program grid 150 to present programming information, 
whereas the IEPG display 600 of FIG. 6 utilizes an enhanced "hide 
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and reveal" technique to present more information to a viewer 
while reducing the amount of display clutter experienced by the 
viewer in navigating through the available programming choices. 
Second, the IEPG display 600 of FIG. 6 includes a program 
5 description object that is used to display, illustratively, a brief 

textual description of a program occupying a presently emphasized 
time slot of a presently indicated channel. 

The IEPG display 600 of FIG. 6 comprises a first 605A, second 
605B and third 605C time slot object (collectively time slot object 
10 605), a plurality of channel content objects 610-1 through 610-8 

(collectively channel contact object 610), a pair of channel indicator 
objects 641A and 641B (collectively channel indicator object 641), a 
video barker 620 (and associated audio barker), a cable system or 
provider logo 615, a program description object 650, a day of week 
15 identification object 631, a time of day object 639, a next time slot 
object 634, a temporal increment/decrement object 632, a prompt 
line object 642, a "favorites" filter or selection object 635, a "movies" 
filter or video on demand (VOD) selection object 636, a "kids" (i.e., 
juvenile) programming filter or VOD selection object 637 and a 
20 "sports" programming filter or VOD selection object 638. It should 
be noted that the day object 631 and next time slot object 634 may 
comprise independent objects (as depicted in FIG. 6) or may be 
considered together as parts of a combined object. Each of the 
channel content objects 610-1 through 610-8 comprises a channel 
25 number object NUM, a channel identification object ID, a first title 
object 611A, a second title object 611B and a third title object 611C 
(collectively 611). The channel number object NUM indicates the 
actual or virtual channel number of the channel identified by the 
channel identification object ID. The first 611A, second 611B and 
30 third 611C title objects depict the titles of programs provided by the 
channel during time slots indicated by, respectively, the first 605A, 
second 605B and third 605C time slot objects. 
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The IEPG display 600 of FIG. 6 is logically divided into two 
operational zones or regions, a guide region and an image region. 
The guide region comprises the time slot objects 605, channel 
content objects 610-1 through 610-8 and channel indicator objects 
5 641A and 641B. The image region comprises the remaining objects. 
When a user or viewer is interacting with the program guide of the 
present invention, only one of these two regions will be active. 
Some keys or controls utilized by a viewer to control the IEPG will 
operate differently, depending upon which region is active. The 
10 operational differences between the two regions will be described 
in more detail below. 

Referring now to the guide region of FIG. 6, it can be seen 
that the second time slot 605B is highlighted or emphasized by a 
time slot highlighting object 605H. Similarly, it can be seen that 
15 each respective second title object 611B of each of the plurality of 
channel content objects 610-1 through 610-8 is also emphasized or 
highlighted by a corresponding title highlighting object 611H. Time 
slot emphasis is coordinated. That is, if the first time slot object 
605A is emphasized or highlighted, then the first title object 611A of 
20 each of the plurality of channel content objects 610-1 through 610-8 
is also emphasized or highlighted. Similarly, if the second time slot 
object 605B is emphasized or highlighted, then the second title 
object 611B of each of the plurality of channel content objects 610-1 
through 610-8 is also emphasized or highlighted. This coordinated 
25 highlighting or emphasizing of time slot 605 and title 611 objects 
assists the viewer in determining which titles within the respective 
channel content objects 610-1 through 610-8 are associated with 
which time slot. 

In one embodiment of the invention, the coordinated 
30 emphasis or highlighting of time slot and title objects is 

accomplished by using the graphics layer to de-emphasize the de- 
emphasized or non-highlighted time slot and title objects. That is, 
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the opacity of the graphics layer proximate the de-emphasized or 
non-highlighted time slot and title objects is adjusted to a level of 
opacity that is higher than the level of opacity of the emphasized or 
highlighted time slot and title objects. In the case of only two levels 
5 of opacity, the non-highlighted or de-emphasized objects are hidden 
using a full opacity level, while the highlighted or emphasized 
objects are revealed using a zero opacity level (i.e., transparent 
graphics layer). In the case of more than two levels of opacity, the 
difference in opacity levels between emphasized and de-emphasized 
10 objects is selected to provide clear indication to the viewer of object 
highlighting or emphasis, while retaining the viewer's ability to 
read the non-highlighted or de-emphasized objects. 

In one embodiment of the invention, the coordinated 
emphasis or highlighting an object is accomplished by using the 
15 graphics layer to adjust a color, brightness or other parameter of 
an object, or display area surrounding the object. For example, an 
x-y coordinate grid or other shape surrounding an object to be 
highlighted or emphasized may be changed in color or brightness 
level such that the surrounded or proximate object is emphasized. 
20 Similarly, an x-y coordinate grid or other shape surrounding an 
object to be non-highlighted or de-emphasized may be changed in 
color or brightness level such that the surrounded or proximate 
object is de-emphasized. 

The program description object 650 of the image region is 
25 used to display a description of a presently indicated title. The 

description comprises, illustratively, one or more of a brief textual 
description of the title, title start and end times, title run time, title 
ratings (e.g., MPAA or other ratings), title reviews (e.g., "thumbs- 
up" or "thumbs-down" or other qualitative indicia), ranking of title 
30 in comparison to other titles (e.g., popularity, aggregated positive 
or negative viewer feedback) and the like. 
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The pair of channel indicator objects 641A and 641B (or a 
single channel indicator object 641A or 641B) is used to indicate 
which of the plurality of channel content objects 610-1 through 610- 
8 includes a highlighted or emphasized title object 611 having 
5 associated with it a textual description within the program 

description object 650. That is, the channel indicator objects 641A 
and 641B provide a visual indication of a presently indicated 
channel to the viewer. 

It is important to note that the video barker 620 of FIG. 6 (and 

10 the video barker 120 of FIG. 1) is, itself, an object that may be 

selected in some embodiments of the invention. Specifically, in an 
embodiment where the video barker 620 is used to present a movie 
trailer, selection of the video barker object 620 by the user implies a 
desire to view that movie in, e.g., a video-on-demand context. Thus, 

15 in an embodiment of the invention where the video barker 

comprises an active or selectable object, selection of the video 
barker brings the user to a video-on-demand interaction screen 
where the user is provided with the opportunity to purchase the 
movie presented in the video barker. Similarly, where the video 

20 barker is used to present merchandise or other products and/or 
services for sale, selection of the video barker results in the user 
being brought to an interaction screen suitable for fulfilling a 
user's desire to purchase or shop for such goods and/or services 
(e.g., an advertisement from a store associated with a virtual mall, 

25 an advertisement for a restaurant associated with a food coupon 
retrieval system providing coupons via either virtual or via regular 
mail after entering a name and address). 

Referring now to FIG. 6, the second channel contact object 
610-2, which is indicated by the channel indicators 641A and 641B, 

30 includes a second title 611B that is associated with the highlighted 
or emphasized second time slot 605B. In one embodiment of the 
invention, selecting this title (i.e., pressing a "select" key on a 
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remote control device when the guide regions is active), which is to 
be presented in the future, results in the user being transferred to a 
preview screen depicting a preview of the selected title. For 
example, in the case of the selected title being a television sitcom to 
5 be broadcast in, e.g., 20 minutes from the present time, selecting 
that title results in the user being taken to a preview information 
screen related to the sitcom. Similarly, in the case of the selected 
title being a boxing match (or other sporting event), such an event 
is usually associated with a pre-game show or pre-fight program. 

10 this pre-game show or pre-game program may be on one or more 
channels. Thus, in the case of a sporting event being associated 
with one or more pre-game or pre-event programs, the user is 
brought to a screen in which he may select which of these pre-event 
programs he would like to view. Alternatively, the user is brought 

15 to a screen providing information regarding the upcoming fight or 
sporting event. 

When the guide region is active, user manipulations of left or 
right arrow keys on, e.g., a remote control device, result in a change 
in the highlighted or emphasized time slot, while user 

20 manipulations of up or down arrow keys result in a change in the 
indicated channel. In the case of a change in time slot or channel 
indication, the contents of the title description information that is 
displayed as the program description object 650 are also changed. 
The guide region becomes inactive and the image region becomes 

25 active when the user utilizes the left or right arrow keys to 

highlight or emphasize an object within the image region (i.e., icons 
631-639). The response of the system to various user manipulations 
will be described in more detail below with respect to FIGS. 8-9. 
Referring now to FIG. 6, the guide region of the interactive 

30 program guide display 600 (i.e., the video layer provided by the 

head end) presents to a viewer a tabular representation of available 
programming on a predefined number of channels (e.g., eight 
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channels) and for a predefined period of time (e.g., 1 l / 2 hours) 
utilizing a "hide and reveal" technique. That is, each of the eight 
channels displayed (e.g., channels 17-24) is associated with a title 
for each of the three time slots of interest. By highlighting a 
5 particular time slot (via left/right arrow key activation), the 
appropriate titles within the displayed channels are in turn 
emphasized. 

There are several important considerations that must be 
understood with respect to the use of interactive electronic 
10 program guides by a user. First, it is important to the user that the 
time and title information is clearly presented in a way that is 
understandable and without causing undue eyestrain due to, e.g., 
screen clutter. The invention reduced screen clutter by the use of 
selective emphasis, including changes in opacity, to de-emphasize 
15 title information and/or time information. Moreover, the invention 
provides a clear and concise presentation of available programming 
by using the multiple title objects (611A through 611C) in a 
coordinated fashion with appropriate channel content objects (610- 
1 through 610-8) and time slot objects (605A through 605C). In this 
20 manner, more information may be provided on the screen without a 
deleterious impact to the subjective viewing quality of the IEPG 
display. 

It should be noted that while the channel content object 610-1 
through 610-8 are described as comprising three title objects 611A 

25 through 611C, more or fewer title objects may be displayed or 
provided. Similarly, while three time slot objects 605A-605C are 
described, more or fewer time slot objects may be utilized. 
Advantageously, by including more time slot objects or more title 
objects the total number of video streams needed to represent the 

30 program guide is reduced. For example, in a system having 80 
channels, ten video PIDs are required to represent respective 8- 
channel portions of the available channels. Moreover, while the 
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display is shown with 8 channel content objects 610-1 through 610-8, 
more or fewer channel content objects may be displayed. The 
embodiments using three time slot objects associated with 
respective three title objects and within eight channel content 
5 objects provide pleasing display imagery on current display devices 
such as NTSC, PAL, and SECAM television screens. As increased 
resolution display devices become more readily available, the 
number of title objects within each channel content object may be 
increased (thereby increasing the number of time slot objects 
10 represented in a single screen) and/or the number of channel 
content objects may be increased without any significant 
degradation in display quality. 

An important aspect of the invention is the program 
description object 650. The program description 650 describes 
15 information relating to a presently emphasized title of a presently 
indicated channel. The presently emphasized title is that title 
associated with a presently emphasized time slot within a presently 
indicated channel. The combined features of the program 
description object and the various emphasis and de-emphasis 
20 protocols developed with respect to the present invention provide a 
high quality navigation experience to the interactive electronic 
program guide viewer. 

In a system comprising 80 channels, where channels are 
displayed in 8-channel groups having associated with them three 
25 half hour time slots, it is necessary to provide 10 video streams to 
carry the present-time channel/time/title information, one audio 
stream to carry the audio barker and/or a data stream (or other 
data transport method) to carry the program description data, 
overlay data and the like. To broadcast program information up to 
30 24 hours in advance, it is necessary to provide 160 (10*24/1.5) video 
streams, along with one audio and, optionally, one or more data 
streams. The amount of time provided for in broadcast video 
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streams for the given channel groups comprises the time depth of 
the program guide, while the number of channels available through 
the guide (compared to the number of channels in the system) 
provides the channel depth of the program guide. In a system 
5 providing only half of the available channels via broadcast video 
streams, the channel depth is said to be 50%. In a system providing 
12 hours of time slot "look-ahead," the time depth is said to be 12 
hours. In a system providing 16 hours of time slot "look-ahead" and 
4 hours of time slot "look-back," the time depth is said to be +16/-4 
10 hours. It should be noted that each video, audio and, optionally, 
data stream has associated with it a respective PID. 

The video streams for the IEPG display may be included as a 
PES within a single transport stream. Thus, a user desiring to view 
the next 1 V2 hour time interval (e.g., 9:30 - 11:00) may activate a 
15 "scroll right" object (or move the joystick to the right when a 

program within program grid 150 occupies the final displayed time 
interval). Such activation will result in the controller of the STT 
noting that a new time interval is desired. The video stream 
corresponding to the new time interval will then be decoded and 
20 displayed. If the corresponding video stream is within the same 
transport stream (i.e., only a new PID), then the stream will be 
immediately decoded and presented. If the corresponding video 
stream is within a different transport stream, then the different 
transport stream will be extracted from the broadcast stream and 
25 the appropriate video stream will be decoded and presented. If the 
corresponding transport stream is within a different broadcast 
stream, then the different broadcast stream will be tuned, the 
different transport stream will be extracted from the different 
broadcast stream, and the appropriate video stream will be 
30 decoded and presented. 

Similarly, a user interaction resulting in the selection of a 
prior time interval or a different set of channels will result in the 
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retrieval and presentation of an appropriate video stream. If the 
appropriate video stream is not normally part of the broadcast 
video streams, then a pointcast session is initiated. That is, the STT 
send a request to the head end via the back channel requesting a 
5 particular stream. The head end processes the request, retrieves 
the appropriate stream, incorporates the stream within a transport 
stream as a video PID (ideally the transport stream currently being 
tunes/selected by the STT) and informs the STT which PID should 
be demultiplexed, and from which transport stream it should be 

10 demultiplexed from. The STT then retrieves the appropriate video 
PID. In the case of the appropriate video PID being within a 
different transport stream, the STT must first demux the different 
transport stream (possibly even tuning a different QAM stream 
within the forward channel). 

15 Upon completion of the viewing of the appropriate stream, 

the STT indicates to the head end that the STT no longer needs the 
stream, whereupon the head end tears down the pointcast session. 
It should be noted that in one embodiment of the invention, the 
head end causes multiple STTs to "share" a pointcast stream. That 

20 is, if a first STT request a video stream that is currently being 

provided to a second STT, the head end will guide the first STT to 
the PID and (optionally) transport stream providing the video 
stream to the second STT. If the second STT indicates to the head 
end that it is finished viewing the video stream, the head end 

25 determines if another STT (i.e., the first STT) is still utilizing the 
video stream. If the stream is still being utilized, the pointcast 
session is not torn down (at least not with respect to the STT(s) 
utilizing the video stream). In this manner, forward channel 
bandwidth and head end video processing resources are conserved. 

30 The above-described sharing of pointcast streams is 

especially useful within the IEPG display context where relatively 
low channel depth and/or time depth is used. In such a case, it is 
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quite likely that several users will want to contemporaneously view 
information that may be packaged within the same video stream. 
Thus, an adaptive narrowcast (or group pointcast) system is 
provided, wherein the head end is able to adapt resource allocation 
5 to the sub-set of users exhibiting a coordinated need for 

information. These adaptive narrowcast sessions are created and 
torn down as necessary in response to changing user demand. In 
the event of a very high level of utilization of streams associated 
with a particular channel group(s) or time slot(s), the head end may 
10 determine that the processing, memory, and bandwidth resources 
required to create, manage, and tear down the narrowcast of such 
streams is greater than the resources required to simply provide 
such streams as broadcast streams. In one embodiment of the 
invention the head end will adapt the depth of the broadcast 
15 stream to accommodate the high utilization stream(s). This 
accommodation does not require the addition of contiguous 
channel groups or time slots, only the addition of PIDs allocated to 
the high utilization stream(s). 

It is important to note that each extracted IEPG video stream 
20 is associated with a common audio stream. Thus, the video/audio 
barker function of the program guide is continuously provided, 
regardless of the selected video stream. 

FIG. 7A depicts a diagrammatic representation of a multiple 
program transport stream suitable for use in the interactive 
25 information distribution system of FIG. 4. Specifically, FIG. 7A 

depicts a diagrammatic representation of a system stream 710 and a 
transport stream 720. 

The system stream 710 comprises, illustratively, a quadrature 
amplitude modulation (QAM) system stream conveyed by a forward 
30 channel within the DIVA system. Specifically, the system stream 
710 comprises a plurality of transport streams, including transport 
streams A-H (711-718). Each of the transport streams includes at 
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least one video stream, one audio stream and, optionally, one or 
more data elementary streams or packetized elementary streams 
(PES). Each elementary stream within the system stream 710 has 
associated with it a unique packet identification (PID) number. 

5 The transport stream 720 depicts an exemplary plurality of 

elementary streams associated with a first transport stream 711 
(denoted as stream A) and a second transport stream 712 (denoted 
as stream B). Specifically, first transport stream 711 (i.e., stream A) 
comprises five elementary streams (721-725), each of which has 
10 associated with it a respective PID. The five elementary streams 
(721-725) of stream A are used to provide video, audio, and 
graphics/data information to a set top terminal such that the set top 
terminal is capable of producing, via a display device, an IEPG 
display such as described above with respect to FIGS. 1 or 6. The 

15 utilization of the transport stream 720 will now be discussed with 
respect to FIG. 7B. 

In an exemplary embodiment of the invention, the system 
stream 710 comprises a constant bitrate stream having a bitrate of 
3.37125 million bits per second (Mbps), each video PES has a bitrate 

20 of 1.05 Mbps, each audio PES has a bitrate of 192 Kbps (44.1kHz 

audio) or 224 Kbps (44kHz audio) while the remaining bandwidth is 
utilized by data streams, overhead and the like. It will be 
appreciated by those skilled in the art that the bitrate of any of 
these streams may be adapted to, e.g., provide minimum video 

25 and/or audio quality levels, provide maximum video and/or audio 
quality levels, to provide for a maximum number of video and/or 
audio elementary streams within a transport stream and other 
system design criteria. The exemplary bitrates are only provided to 
give a sense of the bandwidth utilization of a system utilizing the 

30 teachings of the invention. The actual bitrates will increase or 
decrease as the system is upgraded and the like. 
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FIGS. 7B through 7E depict respective tabular 
representations of exemplary utilizations of a single program 
transport stream providing program guide information and 
suitable for use in the multiple program transport stream of FIG. 
5 7A. Specifically, each of the disclosed data structures provides one 
or more video streams for carrying image guide and image region 
image information. The IEPG displays may be provided entirely in 
a single transport stream (FIG. 7E), in individual transport streams 
(FIG. 7D), in groups within transport streams (FIG. 7A), and in 

10 overlapping groups within transport streams (FIG. 7B). Each of the 
data structures described in FIGS. 7A-7D may be readily produced 
using the server-side or head end apparatus described above with 
respect to FIG. 4. 

FIG. 7D depicts a tabular representation of an exemplary 

15 utilization of a pair of single program transport streams providing 
program guide information and suitable for use in the multiple 
program transport stream of FIG. 7A. Specifically, FIG. 7D depicts 
a tabular representation 700D of a single program data structure 
for carrying program guide information. That is, each of the single 

20 program transport streams (A-H) of the multi-program transport 
stream 710 comprises a single video PID, a single audio PID and, 
optionally, a data PID. Thus, a single program transport stream is 
required for each video PID. As previously noted, the information 
normally included within the data PID may be included within, e.g., 

25 a private data field or other location within the included video 
stream or audio stream. 

Referring now to the tabular representation 700D of FIG. 7D, 
a first single program transport stream A comprises a video stream 
having associated with it a PID of 1 that contains IPG display 

30 screen image data related to channels 1-8; an audio stream having 
associated with it a PID of 2 that contains an audio track or audio 
barker for the video barker 120 of FIG. 1 or 620 of FIG. 6; and a data 
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stream including overlay information, program or title description 
information or other information suitable for providing the IPG 
functionality. Similarly, a second a single program transport 
stream B comprises a video stream having associated with it a PID 
5 of 4 that contains IPG display screen image data related to 

channels 9-16; an audio stream having associated with it a PID of 5 
that contains the same audio track or audio barker contained in 
the first single program transport stream A; and a data stream 
associated with channels 9-16 (including overlay information, 

10 program or title description information or other information 
suitable for providing the IPG functionality). 

FIG. 7E depicts a tabular representation of an exemplary 
utilization of a single program transport stream providing program 
guide information and suitable for use in the multiple program 

15 transport stream of FIG. 7A. The data structure of FIG. 7E is 
denoted by the inventor as a "super-ganging" data structure. 
Specifically, FIG. 7E depicts a tabular representation 700E of a 
multiple program data structure for carrying all of the program 
guide information. That is, one of the single program transport 

20 streams (A-H) of the multi-program transport stream 710 is used to 
provide the necessary video PIDs to contain all of the IEPG 
displays to be provided in broadcast mode. 

Referring now to the tabular representation 700E of FIG. 7E, 
a single program transport stream A comprises N video streams, 

25 each of the N video streams being associated with a respective PID 
and containing IPG display screen image data related to a 
respective channel group (illustratively an eight channel group); an 
audio stream having associated with it a PID of N+l; and a data 
stream having associated with it a PID of N+2. 

30 Advantageously, the "super-ganging" data structure provides 

for the most rapid changes between video PIDs, since each video 
PID is within the same transport stream. 
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FIG. 7B depicts a tabular representation of an exemplary 
utilization of a pair of single program transport streams providing 
program guide information and suitable for use in the multiple 
program transport stream of FIG. 7 A. The data structure of FIG. 7B 
5 is denoted by the inventor as a "ganging" data structure. 

Specifically, FIG. 7B depicts a tabular representation 700B of a 
multiple program data structure wherein each transport stream 
comprises a respective plurality of program guide information. 
That is, two or more of the single program transport streams (A-H) 
10 of the multi-program transport stream 710 are used to provide the 
necessary video PIDs to contain all of the IEPG displays to be 
provided in broadcast mode. 

Referring now to the tabular representation 700B of FIG. 7B, 
each of a first A and second B single program transport stream 
15 comprises three respective video streams, with each of the three 
video streams being associated with a respective PID and 
containing IPG display screen image data related to a respective 
channel group (illustratively an eight channel group); a respective 
audio stream having associated with it a respective PID; and a 
20 respective data stream having associated with it a respective PID. 

Advantageously, the "ganging" data structure provides for 
rapid changes between video PIDs, where the video PID to be 
selected is within the same transport stream as the video PID 
presently selected. Moreover, the "ganging" data structure allows 
25 for the construction of relatively small transport streams, 

compared to the "super-ganging" structure described above with 
respect to FIG. 7E. 

FIG. 7C depicts a tabular representation of an exemplary 
utilization of a number of single program transport streams 
30 providing program guide information and suitable for use in the 
multiple program transport stream of FIG. 7A. The data structure 
of FIG. 7C is denoted by the inventor as an "overlapping ganging" 
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data structure. Specifically, FIG. 7C depicts a variation of the data 
structure described above with respect to FIG. 7B. In the data 
structure of FIG. 7C, each single program transport stream (A-H) 
comprises at least one video PID that contains an IPG display of a 
5 channel group that duplicates the contents of a video PID found in 
another single program transport stream. By contrast, the data 
structure of FIG. 7B does not duplicate the IPG display of a channel 
group. The "overlapping ganging" structure utilizes a multiple 
program data structure wherein each transport stream comprises a 
10 plurality of program guide information, including overlapping 
program guide information. That is, two or more of the single 
program transport streams (A-H) of the multi-program transport 
stream 710 are used to provide the necessary video PIDs to contain 
all of the IEPG displays to be provided in broadcast mode. 
15 Referring now to the tabular representation 700C of FIG. 7C, 

each of a first A, second B, and third C single program transport 
streams comprise three respective video streams, with each of the 
three video streams being associated with a respective PID and 
containing IPG display screen image data related to a channel 
20 group (illustratively an eight channel group); a respective audio 
stream having associated with it a PID of 4; and a respective data 
stream having associated with it a PID of 5. 

Referring to the second B single program transport stream, 
the first video PID contains channel group 9-16, the second video 
25 PID contains channel group 17-24, and the third video PID contains 
channel group 25-32. Note that the first video PID of the second B 
single program transport stream contains the same channel group 
as the third video PID of first A single program transport stream; 
and that the third video PID of the second B single program 
30 transport stream contains the same channel group as the first video 
PID of third C single program transport stream. 
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Advantageously, the "overlapping ganging" data structure 
provides for rapid changes between video PIDs, where the video 
PID to be selected is within the same transport stream as the video 
PID presently selected. Additionally, since the contents of the first 
5 and/or last video PIDs are included within two transport streams, 
the STT can utilize stream priming methods to select the second 
transport stream and transition the user to viewing the same IEPG 
display, but derived form a video stream within the second 
transport stream. Stream priming comprises requesting that the 

10 head-end delivers a stream prior to, or in anticipation of, the need 
for the stream by a set top terminal, as will be discussed below. In 
this manner, delays experienced by the user of the STT in changing 
from one transport stream to another are reduced, since the change 
is actually executed as a background process. Thus, the use of the 

15 "overlapping ganging" data structure and the stream priming 

technique provides most of the advantages of the "super-ganging" 
structure, but without the use of very large transport streams. 

While the ganged 700B and overlapping 700C data structures 
are depicted as including only three video streams, each of these 

20 data structures may include more or fewer video streams. In one 
embodiment of the invention, each of the single program transport 
stream (A-H) comprises 10 video PIDs. In the case of the 
overlapping 700C data structure, the first video PID of each stream 
contains the same channel group as the last video PID of the 

25 preceding stream. Similarly, the last video PID of each stream 

contains the same channel group as the first video PID of the next 
stream. The terms "preceding" and "next" within this context 
indicate streams that carry contiguous EIPG display information, 
in either a channel-sense (e.g., adjoining channel groups) or a time 

30 slot sense (e.g., adjoining time slots). 

An important aspect to the invention is the "stream priming" 
aspect. Stream priming is a method of anticipating that a 
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particular stream will be required and requesting that stream prior 
to the actual need for that stream. For example, where a user 
receiving a pointcast IEPG stream has traversed to within a 
threshold level of the upper or lower channel or time slots 
5 displayed, it is likely that the user will continue past the channel or 
time slot boundaries of the IEPG display. In this case, when the 
user reaches the threshold level, the STT sends a request for the 
appropriate next stream to the head end of the system. The head 
end processes the request and begins delivering the appropriate 

10 stream. In the case of the appropriate stream being delivered via 
the same transport stream currently being demultiplexed by the 
STT (a preferred embodiment), the STT simply selects the PID of 
the appropriate stream when the user exceeds the upper or lower 
channel or time slots displayed. In this manner, the latency 

15 inherent in requesting and receiving the appropriate stream is 
greatly reduced. 

The first video stream (PID 1) comprises all the information 
necessary to produce a video layer for the IEPG display 600 of FIG. 
6, including channel content objects 610-1 through 610-8 associated 

20 with channels 1-8 for a defined time period. The second video 

stream (PID 2) and third video stream (PID 3) differ from the first 
video stream (PID 1) in that the second video stream (PID 2) and 
third video stream (PID 3) comprise the information necessary to 
produce a video layer including channel content objects 610-1 

25 through 610-8 associated with, respectively, channels 9-16 and 
channels 17-24. 

The audio stream (PID 4) comprises the audio information 
necessary to produce the audio barker associated with the video 
barker 620 (e.g., the voice-over of a movie trailer displayed within 

30 the video barker 620 of the image region of the display. 

The data/graphics stream (PID 5) comprises the title 
description information that is displayed as the program 
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description object 650. That is, data/graphics stream (PID 5) 
comprises a textual description of each title provided by channels 
1-8 for each of the displayed time slots (e.g., three half hour slots). 
The textual description of the titles is processed by the graphics 
5 processing elements of the STT such that the textual description of 
a presently highlighted or emphasized title of an indicated channel 
is presented to a viewer via the graphics layer of the IEPG display 
600 of FIG. 6. 

It is important to note that graphics and/or data information 
10 may be conveyed to a set top terminal using a data stream 

associated with a unique PID (as depicted here), as private data 
within the adaptation headers of the transports stream packets, or 
by other means (e.g., encoded within the video data using, e.g., 
watermarking techniques). Moreover, since the data stream is used 
15 to convey program identification data or other data that does not 
need to be provided in real time, such data may be used to build a 
local database of, e.g., favorite programming and the like. However, 
the favorite programming database does not comprise a program 
guide database. Rather, the favorite programming database 
20 comprises sufficient information to identify the favorite program or 
title, illustratively, the transport stream and video PID providing 
the appropriate channel group, an index into the channel group 
(e.g., third channel from start), an index into the time slots (e.g., 
second time slot) and the like. There is no need to store the actual 
25 title of the program, only to determine which titles should be 
highlighted or emphasized in a favorite viewing mode. 

Referring now to FIG. 7B, transport stream A comprises three 
video PES streams having respective PID values or 1, 2, and 3. 
Each video PES includes video information for providing the video 
30 layer of a program guide display, such as depicted above with 
respect to FIGS. 1 and 6. Each video PES stream has associated 
with it the channel guide information of a respective plurality of 
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channels. Within the context of the program guide display of FIG. 
1, each video PES includes channel guide information associated 
with a respective 10 channels arranged according to the grid 
display described above with respect to FIG. 1. Within the context 
5 of the program guide display of FIG. 6, each video PES includes 
channel guide information associated with a respective 8 channels 
arranged according to the mask and reveal display described above 
with respect to FIG. 6. 

FIG. 8A depicts a contextual flow diagram useful in 
10 understanding the invention. Specifically, the contextual flow 
diagram 800A of FIG. 8A depicts changes in the contextual flow of 
the IEPG display screen 600 in response to horizontal increment 
and decrement (rightAeft) commands, such as right arrow and left 
arrow key activations from, e.g., a remote control. Each of the 
15 objects depicted in the contextual flow diagram comprises a video 
object having associated with it a graphics object or overlay 
providing emphasis to indicate an active (i.e., selectable) object or 
de-emphasis to indicate a non-active object (i.e., non-selectable). 

The objects depicted in the contextual flow diagram 800A of 
20 FIG. 8A comprise a subset of the objects depicted in the IEPG 
display screen 600 of FIG. 6. Specifically, the objects depicted in 
the contextual flow diagram 800A of FIG. 8A comprise, in the order 
of emphasis in response to a right arrow or horizontal increment: 
the first 605A, second 605B and third 605C time slot objects of the 
25 IPG display screen guide region. These objects are followed by the 
following IPG display screen image region objects: day of week 
identification object 631, next time slot object 634, "favorites" filter 
object 635, "movies" filter or video on demand (VOD) selection 
object 636, a "kids" filter or VOD selection object 637, and "sports" 
30 filter or VOD selection object 638. It should be noted that while the 
objects depicted in the contextual flow diagram 800A comprise 
objects depicted in the IEPG display screen 600, the IEPG display 
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100 of FIG, 1 and other IPG display screens may be adapted 
accordingly. 

For purposes of this discussion it will be assumed that the 
first object to be highlighted or emphasized is the first time slot 
5 object 605A. Referring now to FIG. 8A, in response to a first right 
arrow or horizontal increment 801, the first time slot object 605A is 
de-emphasized and the second time slot object 605B is emphasized; 
in response to a second right arrow or horizontal increment 802, 
the second time slot object 605B is de-emphasized and the third 
10 time slot object 605C is emphasized; in response to a third right 

arrow or horizontal increment 803, the third time slot object 605 C is 
de-emphasized and the day of week identification object 631 is 
emphasized, and so on for the (804) next time slot object 634; (805) 
"favorites" object 635; (806) "movies" selection object 636; (807) 
15 "kids" selection object 637; (808) "sports" selection object 638, and, 
finally, the (809) first time slot object 605 A. 

The graphical depiction of FIG. 8A is divided into those 
objects associated with an active guide region (the three time slots 
605A-605C) and those objects associated with an active image 
20 region (the remaining objects 631-638). This delineation is used to 
determine the functionality of vertical increment (up arrow), 
vertical decrement (down arrow), page up, and "page down" keys. 
The differences between guide region and image region key 
functionality will be discussed in more detail below with respect to 
25 FIGS. 8B and 9A (guide region functionality) and FIGS. 8C and 9B 
(image region functionality). 

When the guide region is active (any of objects 605A-605C 
emphasized), the up and down arrow keys are used to scroll 
through the various portions of the guide region. That is, the 
30 presently indicated (via channel indicator objects 641A and/or 
641B) channel content object (610-1 through 610-8) is changed by 
one (i.e., incremented or decremented) in response to up arrow or 
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down arrow activation. Similarly, the displayed video stream is 
changed (via selecting the next or prior video PID) in response to 
page up or "page down" key activation. Thus, active guide region 
functionality provides for navigation of the various video streams 
5 providing broadcast IPG screens to a user. 

When the image region is active (any of objects 631-638 
emphasized), the up and down arrow keys are used to adjust the 
presently indicated next time slot object 634, while the page up and 
"page down" keys are used to adjust the day of week identification 
10 object 631. Specifically in response to an up arrow key activation, 
the presently indicated next time slot object 634 is incremented by, 
e.g., 1 Va hours by selecting the video PID including the guide 
information for the next three time slots of the current channels 
presented in the guide region. Similarly, in response to a "page up" 
15 key activation, the presently indicated day of week identification 
object 631 is incremented by one day by selecting the video PID 
including the guide information for the next day of the current 
channels presented in the guide region. 

In the case of a "deep time depth" broadcast of guide 
20 information (i.e., broadcast of present, future and/or past guide 

information on appropriate video streams), the broadcast video PID 
including the appropriate guide screen is selected. If such a 
broadcast video PID is not available, then the STT makes a request 
for such a stream via the back channel (i.e., a pointcast mode is 
25 entered). Upon tuning and/or demultiplexing the transport stream 
including the requested pointcast or narrowcast video PID, the 
requested video PID is selected and, if necessary, a different audio 
stream and data stream is selected. 

FIG. 8B depicts a contextual flow diagram useful in 
30 understanding the invention. Specifically, the contextual flow 

diagram 800B of FIG. 8B depicts changes in the contextual flow of 
the IEPG display screen 600 in response to vertical increment and 
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decrement (up/down) commands received while a guide region 
object is highlighted or emphasized. 

The objects depicted in the contextual flow diagram 800B of 
FIG. 8B comprise a subset of the objects depicted in the IEPG 
display screen 600 of FIG. 6. Specifically, the objects depicted in 
the contextual flow diagram 800B of FIG. 8B comprise the channel 
content objects 610-1 through 610-8 as indicated by the channel 
indicator objects 641A and/or 641B. In response to successive down 
arrow or vertical "decrement" key activations, the indicated 
channel content object traverses from 610-1 to 610-2 (820); 610-2 to 
610-3 (821); 610-3 to 610-4 (822); 610-4 to 610-5 (823); 610-5 to 610-6 
(824); 610-6 to 610-7 (825), and 610-7 to 610-8 (826). Similarly, 
activating an up arrow or vertical "increment" key changes the 
indicated channel in the reverse manner. 

In response to a down arrow activation while channel object 
610-8 is indicated, the "next" video PID is selected for display. That 
is, the video PID containing the next eight channels to be displayed 
for the currently viewed time slot is selected. If the last eight 
channels are presently being displayed, than the video PID 
associated with the first eight channels is selected (i.e., channel 
"roll-over"). In the case of the "next" video PID being part of a 
different transport stream (i.e., a "next" transport stream), it is first 
necessary to tune and/or decode the next transport stream to 
extract (i.e., demultiplex) the appropriate video PID and the 
associated audio and data PIDs. 

In response to an up arrow activation while channel object 
610-1 is indicated, the "prior" video PID is selected for display. 
That is, the video PID containing the prior eight channels to be 
displayed for the currently viewed time slot is selected. If the first 
eight channels are presently being displayed, than the video PID 
associated with the last eight channels is selected (i.e., channel 
"roll-under"). In the case of the "prior" video PID being part of a 
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different transport stream (i.e., a "prior" transport stream), it is 
first necessary to tune and/or decode the next transport stream to 
extract (i.e., demultiplex) the appropriate video PID and the 
associated audio and data PIDs. 
5 If the system is in a pointcast mode when the need to change 

the displayed channel arises, then the issue of latency must be 
addressed. Specifically, to receive a pointcast PID, it is first 
necessary to request such a PID from the head end of the system. 
Ideally, the requested PID will be conveyed to the requesting STT 
10 via the same transport stream presently being tuned and 

demultiplexed by the requesting STT. In one embodiment of the 
invention, the head end will adjust, e.g., the program map table 
(PMT) or program association table (PAT) of the transport stream 
including the requested PID such that the STT may determine 
15 which video PID (and possibly which audio and data PIDs) should 
be selected to realize the channel roll-over or roll-under function 
(i.e., select receive and display another stream). 

To reduce latency in requesting a PID during pointcast or 
narrowcast mode, the STT optionally issues a request prior to the 
20 traversal of the first 610-1 or last 610-8 channel content object. 
Specifically, FIG. 8B depicts the requesting 831 of a next channel 
PID contemporaneous to the indicated channel content object 
traversal of 610-6 to 610-7 (825); and the requesting 830 of a prior 
channel PID contemporaneous to the indicated channel content 
25 object traversal of 610-3 to 610-2 (821). Thus, when the actual roll- 
over 827 or roll-under 827 channel content object traversal is 
desired, the appropriate next or prior video PID is likely to be 
readily available, thereby masking the latency in procuring the 
video PID during the pointcast or narrowcast mode. The above- 
30 described latency masking technique allows more rapid acquisition 
of an appropriate next or prior PID at the expense of providing 
multiple PIDs to a single STT. 
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FIG. 8C depicts a contextual flow diagram useful in 
understanding the invention. Specifically, the contextual flow 
diagram 800C of FIG. 8C depicts changes in the contextual flow of 
the IEPG display screen 600 in response to vertical increment and 
5 decrement (up/down) commands received while an image region 
object is highlighted or emphasized. 

The object depicted in the contextual flow diagram 800C of 
FIG. 8C comprises the next time slot object 634 depicted in the 
IEPG display screen 600 of FIG. 6. Specifically, when an image 
10 region object is activated, the next time slot object 634 is 

incremented or decremented in response to, respectively, an up 
arrow or vertical "increment" key activation and a down arrow or 
vertical "decrement" key activation. In the exemplary embodiment, 
the next time slot object 634 is delineated in 1 V2 hours intervals 
15 (i.e., the time slot following the three time slots 605A, 605B and 605C 
of the guide region) for a 24-hour period. 

In one embodiment of the invention, the operations described 
in the contextual flow diagram shown in FIG. 8C only occur if the 
next time slot object 634 or a combined object comprising the day 
20 object 631 and next time slot object 634 are highlighted or 
emphasized. In another embodiment of the invention, the 
operations described in the contextual flow diagram shown in FIG. 
8C occur when any image regions object is highlighted or 
emphasized. 

25 In response to successive up arrow or vertical "increment" key 

activations, the indicated next time slot object traverses from the 
actual (with respect to the present time) next time slot (851) to a 
next time slot + 3 (852) via path 8512; a next time slot + 6 (853) via 
path 8523; a next time slot + 9 (854) via path 8534, and so on up to a 

30 next time slot + 21 (858) via path 8578. An additional up arrow or 
vertical "increment" key activation results, in the present 
embodiment, in a return to the next time slot (851) via path 8581. 
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Similarly, activating a down arrow or vertical "decrement" key 
changes the indicated next time slot object in the reverse manner, 
except for one case. Specifically, in the case of activating a down 
arrow or vertical "decrement" key when the next time slot (851) is 
5 indicated, the system enters a time shift mode 856 via path 8516. 

The time shift mode 856 comprises the retrieval, via pointcast, 
of video PID associated with programming that has already been 
presented. That is, the time shift mode comprises a mode of 
retrieving previously broadcasted programming, such as network 

10 programming, sporting events and the like. Upon entering this 
mode, the STT user interacts with the server to arrange for the 
selection and/or payment of such time shifted programming 
material. It is noted that the programming guide information 
associated with time-shifted material may be incomplete due to 

15 business-related restrictions on time shifting or "second broadcast" 
programming. However, in the case where the head end of the 
system records all the contents of each channel for a predefined 
period of time (e.g., 2 weeks), the title and prior presentation time 
of the recorded programming material are viewed and selected 

20 using the IPG screens of the present invention. 

FIG. 9A depicts a contextual flow diagram useful in 
understanding the invention. Specifically, the contextual flow 
diagram 900A of FIG. 9A depicts changes in the contextual flow of 
the IEPG display screen 600 in response to page up and page down 

25 commands received while an object within the image region is 
highlighted or emphasized. 

The changes in contextual flow of the contextual flow 
diagram 900A of FIG. 9A comprise the selection of a video PID 
including the presently viewed time slots of channels prior to (page 

30 up) or after (page down) the channels of the presently selected 
video PID, when a guide region object is activated. 
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In response to successive "page up" key activations, the 
following traversals are made: from a present group of channels 
PID 901 to a prior group of channels PID 902 via path 9012, from the 
prior group of channels PID 902 to the second prior group of 
5 channels PID (not shown) and so on up to the first group of 

channels PID 903 via path 9023. Further in response to successive 
"page up" key activations, the following traversals are made: from 
the first group of channels PID 903 to a last group of channels PID 
904 via path 9034, from the last group of channels PID 904 to a 
10 second from last prior group of channels PID (not shown) and so on 
up to a next group of channels PID 905 via path 9045, and from the 
next group of channels PID 905 to the present group of channels 
PID 901 via path 9051. 

In response to successive "page down" key activations, the 
15 following traversals are made: from the present group of channels 
PID 901 to the next group of channels PID 905 via path 9051, from 
the next group of channels PID 905 to the second next group of 
channels PID (not shown) and so on up to the last group of 
channels PID 904 via path 9045. Further in response to successive 
20 "page down" key activations, the following traversals are made: 
from the last group of channels PID 904 to the first group of 
channels PID 903 via path 9034, from the first group of channels 
PID 903 to a second group of channels PID (not shown), and so on 
up to the prior group of channels PID 902 via path 9023, and from 
25 the prior group of channels PID 902 to the present group of 
channels PID 901 via path 9012. 

In one embodiment of the invention, changing PIDs will yield 
a guide image in which either the corresponding channel content 
object, the first channel content object, the last channel content 
30 object, or a predetermined channel content object is indicated. 
FIG. 9B depicts a contextual flow diagram useful in 
understanding the invention. Specifically, the contextual flow 
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diagram 900B of FIG. 9B depicts changes in the contextual flow of 
the IEPG display screen 600 in response to page up and page down 
commands received while an image region object is highlighted or 
emphasized. 

5 The changes in contextual flow of the contextual flow 

diagram 900B of FIG. 9B comprise the selection of a video PID 
including the presently viewed time slots of the presently viewed 
group of channels one day in advance of (page up) or one day prior 
to (page down) the channels of the presently selected video PID, 

10 when a guide region object is activated. 

In one embodiment of the invention, the operations described 
in the contextual flow diagram shown in FIG. 9B only occur if the 
day object 631 or a combined object comprising the day object 631 
and next time slot object 634 is highlighted or emphasized. In 

15 another embodiment of the invention, the operations described in 
the contextual flow diagram shown in FIG. 9B occur when any 
image regions object is highlighted or emphasized. 

In response to successive "page up" key activations, the 
following traversals are made: from a present day PID 921 to a next 

20 day PID 922 via path 9212; from the next day PID 922 to a second 
next day PID 923 via path 9223, and so on up to a week ahead PID 
924 via a path 9234, and from the week ahead PID 924 to the present 
day PID 921. 

In response to successive "page down" key activations, the 
25 following traversals are made: from the week ahead PID 924 to a 
week ahead minus one day PID (not shown), and so on to the next 
day PID 922 via paths 9234 and 9223, and to the present day PID 921 
via paths 9212. In the case of a "page down" key activation when the 
present day PID object is highlighted, the system enters the time 
30 shift mode described above via path 9251. Within the time shift 

mode 925, page up and "page down" keys may be used to reach back 
in time to the extent allowed by the system, based upon the amount 
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of programming recorded for subsequent re-presentation to the 
user. 

FIG. 10 depicts a tabular representation of the functions of 
various keys during guide region and image region operation. The 
5 functions of some of the depicted keys have been described above 
and, therefore, will not be additionally discussed. Specifically, FIG. 
10 depicts the guide region and image region functionality of the 
increment (up arrow), decrement (down arrow), page up, page 
down, horizontal increment (move right), horizontal decrement 

10 (move left), select, and add/remove keys. The Select key is used to 
select a highlighted or emphasized object to, e.g., enter a different 
operating mode (image region response) of tune an indicated 
channel (guide region response). The add/remove key is used to 
add a presently tuned channel to the list of favorites. If the 

15 presently tuned channel is already on the list, then the channel is 
removed form the list of favorites. Optionally, the viewer is queried 
as to whether the viewer really intends to remove the channel from 
the favorites list. 

FIGS. 11A-11C, 12A-12C, 13, and 14 depict respective display 

20 screens of interactive electronic program guide (IEPG) displays 
useful in understanding the invention. These IEPG displays are 
similar to the IEPG display 600 depicted above with respect to FIG. 
6. The IEPG displays of FIGS. 11-14 depict different aspects of the 
invention, including variations of a "hide and reveal" aspect of the 

25 present invention. 

Referring to FIG. 11A, the IEPG display 1100A of FIG. 11A 
comprises a first 605A, second 605B and third 605C time slot object, 
a plurality of channel content objects 610-1 through 610-8, a pair of 
channel indicator objects 641A and 641B, a video barker 620 (and 

30 associated audio barker), a cable system or provider logo 615, a 
program description object 650, a day of week identification 631, a 
time of day object 639, a next time slot object 634, a temporal 
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increment/decrement object 632, a "favorite" filter or selection 
object 635, a "movies" filter or selection object 636, a "kids" filter or 
selection object 637, a "sports" filter or selection object 638, and a 
video on demand (VOD) selection object 633. 
5 To simplify the discussion, the various reference designators 

used to describe elements of FIG. 11A will generally not be 
replicated in FIGS. 11B-14. However, a textual reference to a 
reference designator within one of FIGS. 11A-14 should be 
interpreted as a textual reference to the element of the one figure 
10 corresponding to the element so designated within FIG. 11A. 

With the exception of the separate video on demand object 
633, the IEPG display 1100A of FIG. 11A is substantially the same as 
the IEPG display 600 of FIG. 6. The primary difference between the 
display screens 1100A and 600 of FIGS. 11A and 6, respectively, are 
15 as follows. First, in the IEPG display 1100 of FIG. 11A, the first time 
slot 605A is emphasized in that this time slot is depicted as a light 
or high intensity object, while the second 605B and third 605 C time 
slot objects are depicted as low intensity objects. Additionally, the 
first title object 611A of each of the channel content objects 610-1 
20 through 610-8 is emphasized in that each of these objects is 

presented in a full intensity color (illustratively black) while the 
second 611B and third 611C title objects are presented in a muted 
intensity color. In the IEPG display 1100A of FIG. 11A, the muted 
intensity is achieved in the previously described manner by, e.g., 
25 adapting the opacity of the graphic layer to, e.g., 25%, 50% or 75% 
opacity, while the emphasized objects retain 0% opacity (i.e., no 
reduction in brightness). 

The difference between the various IEPG displays depicted in 
FIGS. 11A through 14 will now be described. FIGS. 11A through 11C 
30 depict program guide display screens 1100A through 1100C in 

which the opacity of the title object to be emphasized is set to 0%, 
while the opacity of the title objects to be de-emphasized is set to 
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75%, 50%, 25% or some other percentage suitable for providing a 
visual demarcation to the viewer. 

Referring to FIGS. 11A-11C, it can be seen that the first time 
slot 605A is highlighted in a display screen 1100A of FIG. 11A, the 

5 second time slot 605B is highlighted in the display screen 1100B of 
FIG. 11B, and the third time slot 605C is highlighted in the display 
screen 1100C of FIG. 11C. In this manner, a viewer navigating the 
program guide is presented with a clear emphasis on the time slot 
and channel corresponding to an emphasized title object that is 

10 associated with the information within the title description object 
650. 

Referring now to FIG. 12A, it is noted that the first time slot 
605A is emphasized and that only the first title object 611A within 
each of the channel content objects 610 is shown. That is, only the 
15 title object associated with the emphasized time slot is "revealed," 
while the title objects associated with the non-emphasized time 
slots are "hidden." This "hide and reveal" method of presentation 
provides an IEPG display that some people find more desirable 
than the previously described (with respect to FIGS. 11A through 
20 11C) muting or reduced opacity de-emphasis method of 

presentation. However, the muting or reduced opacity de-emphasis 
method of presentation does present more information to the 
viewer in each IEPG display. 

Referring now to FIGS. 12A through 12C, FIG. 12A depicts a 
25 IEPG display 1200A having the first time slot 605A emphasized and 
each of the title objects 611A associated with that first time slot 
being revealed, while the title objects 611B and 611C associated 
with the non-emphasized time slots 605B and 605C are hidden. In 
FIG. 12A, the first time slot object is emphasized and the second 
30 and third time slots are de-emphasized; in FIG. 12B the second time 
slot object is emphasized, while the first and third time slot objects 
are de-emphasized; and in FIG. 12C, the third time slot object is 
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emphasized while the first and second time slot objects are de- 
emphasized. Note that in all cases the operation of the title 
description object 650 remains unchanged, as does the operation of 
the video barker 120 and all the other functional elements of the 
5 program guide. 

FIG. 13 depicts an IEPG display 1300 that is substantially the 
same as depicted and described above with respect to FIG. 11A. 
The difference between the IEPG displays 1300 of FIG. 13 and 1100A 
of FIG. 11A comprise the use of the next time slot object 634. 
10 Specifically, referring now to FIG. 11A, the next time slot object 634 
indicates that the next time slot is 9:30 p.m. This is correct since 
the third time slot object 605 C is 9:00 and the time slots in the 
exemplary embodiment comprise one half hour each. 

As previously described with respect to FIG. 8C, in the case of 
15 the image region being active, activations of up or down arrows by 
a user via a remote control device result in respective incrementing 
or decrementing of the indicated time slot within the next time slot 
object 634. Upon receiving a select command, the video stream 
including the present channel information for the time indicated by 
20 the selected next time slot object 634 is retrieved. In the case of 
that video stream being part of a currently broadcast or currently 
used video stream (e.g., another user has requested this stream), 
the head end provides information to the set top terminal enabling 
the set top terminal to identify which video stream includes the 
25 appropriate channel guide information. The set top terminal then 
retrieves the appropriate video stream. Of course, where the 
appropriate video stream is located within a different transport 
stream than the transport stream including the presently viewed 
video stream, it will be necessary to also select the audio stream 
30 from the new transport stream. 

Referring now to FIG. 13, a present time object 634* is shown. 
Specifically, rather than the next time slot object 634 of FIG. 11A, 
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the present time object 634' of FIG. 13 depicts the presently 
emphasized time slot or, optionally, the first time slot 605A 
contents. Thus, in the IEPG display 1300 of FIG. 13, the present 
time slot object 634' identifies the present time slot as 9:30 p.m., 
5 which corresponds to the 9:30 time depicted in the first time slot 
object 605A of FIG. 13. 

Referring now to FIG. 14, the IEPG display 1400 depicted in 
FIG. 14 is substantially the same as the IEPG display 1200A 
depicted in FIG. 12A. As previously described above with respect to 
10 FIG. 13, the IEPG display 1400 of FIG. 14 includes a present time 
object 634' that is indicative of the first time slot object 605A within 
the guide portion of the IEPG display. The present time slot object 
634' may be incremented or decremented using appropriate up or 
down arrows to indicate a desired present time slot, which, upon 
15 selection via the SELECT key, will be retrieved by the set top 
terminal and displayed as the IEPG display 1400. 

The IPG display screen 600 of FIG. 6 (and corresponding 
display screens depicted in FIGS. 11 - 14) is shown with channel 
content object 610-1 through 610-8 depicted as a function of time 
20 slots 605A - 605C, where each channel content object includes three 
title objects 611A- 611C. In an alternate mode of operation, time 
slots associated with the group of channels are described for a 
larger amount of time. Similarly, fewer objects are depicted as a 
function of channel content objects. That is, a smaller number of 
25 channel objects 610 is displayed though each displayed channel 
object includes more than three title objects 611. 

It is important to note that the source of information for the 
various information elements of the IEPG displays of FIGS. 1, 6 and 
11-14. Specifically, both the guide region and image region of the 
30 IEPG displays are provided as broadcast, narrowcast or pointcast 
video streams from the head end. That is, the program guide 
information is assembled at the head end and provided as video 
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information to the STTs within the system. Manipulation of video 
layer objects is accomplished by proxy manipulations of graphic 
layer objects. The STT provides (beyond tuning, demultiplexing, 
decoding and such operations) the ability to highlight or emphasize 

5 object and to select a highlighted or emphasized object. The 

graphic information manipulated by the STT is received via a data 
stream (i.e., a data PID), auxiliary data, private data, and the like. 
Advantageously, since there is no local storage of an entire program 
guide database, memory resources of the STT are conserved. 

10 Rather, information sufficient to describe a highlighted program 
title is included within the aforementioned data stream and may be 
contemporaneously transmitted to the STT along with the video 
stream including the channel group/time slots including the 
highlighted program title. 

15 FIGS. 15A and 15B together comprise a user interaction 

method 1500 according to the invention. FIG. 15B also depicts a 
diagram representing an alignment between 15A and FIG. 15B. The 
method 1500 of FIG. 15 comprises a plurality of steps including 
some that perform substantially the same function as depicted 

20 above with respect to the user action method 500 of FIG. 5. 

Specifically, steps 504-522 of the user interaction method 500 of FIG. 
5 operate in substantially the same way as steps 1502-1522 of the 
user interaction method 1500 of FIG. 15. Therefore, these steps will 
not be described in further detail except where such description 

25 indicates changes or additions to the previously described steps 
502-522. 

Referring now to step 1514 of FIG. 15 (which corresponds to 
step 514 of FIG. 5), if the query at step 1514 indicates that local 
interactivity only is requested by the user, then the method 1500 
30 proceeds to step 1540, where a query is made as to the type of key 
pressed by the user. If the query at step 1540 indicates that a 
"freeze" key has been pressed by the user, then the method 1500 
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proceeds to step 1534, where the video frame presently stored in the 
frame store unit 262 is frozen. That is, the frame store unit 262 is 
not updated by subsequent video frames until such time as the 
"freeze" key or other key is pressed. The method 1500 then proceeds 
5 to step 1510, where the processor waits for user input. 

If the query at step 1514 indicates that either an increment or 
"decrement" key has been pressed (e.g., a channel indication 
increment or decrement command) then the method proceeds to 
step 1544. If the query at step 1540 indicates that either a page up 

10 or "page down" key has been pressed, then the method 1500 
proceeds to step 1542. 

At step 1542, a query is made to determine if the pressed or 
activated one of a "page up" or "page down" key is, in fact, the "page 
up" key. If the query at step 1542 indicates that the "page up" key 

15 has been pressed, then the method 1500 proceeds to step 1532. If 
the query at step 1542 indicates that the "page down" key has been 
pressed, then the method 1500 proceeds to step 1526. As previously 
described with respect to FIG. 9A, a "page down" key pressed while 
the guide region is active indicates a desire to select the video 

20 stream including the program guide having a next group of 

channels, while a "page up" key pressed while the guide region is 
active indicates a desire to select the video stream including the 
program guide having a prior group of channels. 

At step 1544, a query is made as to whether an "increment" key 

25 has been pressed. If the query at step 1544 is answered 

affirmatively, then the method 1500 proceeds to step 1546. If the 
query at step 1544 is answered negatively (i.e., a "decrement" key 
has been pressed), then the method 1500 proceeds to step 1548. 
At step 1546, a query is made as to whether a last upper 

30 channel is presently being indicated. That is, a query is made as to 
whether the upper most channel of the program guide (i.e., channel 
content object 610-1) is presently indicated by channel indicators 
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641A and 641B. If the query at step 1546 is answered affirmatively, 
then the method 1500 proceeds to step 1532. Specifically, if the 
upper most channel content object 610-1 is presently indicated, 
then the satisfaction of the user "increment" key input requires the 
5 selection of the video stream including the next channel group (i.e., 
the channel group including a lower channel that is contiguous 
with the presently selected upper channel in a channel guide 
sense). If the query at step 1546 is answered negatively, then the 
method 1500 proceeds to step 1550. 
10 At step 1550, a query is made as to whether an upper 

threshold level has been reached. As previously discussed with 
respect to path 830 of FIG. 8B, an upper threshold level is a level at 
which a request for a prior channel PID should be made if such a 
prior channel PID is unavailable. If the query at step 1550 is 
15 answered affirmatively, then the method 1500 proceeds to step 1552. 
If the query at step 1550 is answered negatively, then the method 
1500 proceeds to step 1558. 

At step 1552, a determination is made as to whether the prior 
channel group is available. An available channel group is a channel 
20 group within a video stream that is presently being broadcast or 
narrowcast or pointcast to one or more set top terminals. As 
previously noted, the set top terminal receives information 
associating each channel group with a particular video stream as 
identified by a unique PID. If the unique PID, or the stream 
25 associated with the unique PID, is not being broadcast, narrowcast, 
or pointcast, then it is appropriate at this time to request that the 
head end begin a pointcast session so that the prior channel group 
may be received by the set top terminal without undue delay (e.g., 
without the user experiencing latency due to the amount of time 
30 required to process and respond to a request for a video stream). 
The method 1500 then proceeds to step 1554. 
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At step 1554, a query is made as to whether the prior channel 
group is available. If the query at step 1554 is answered negatively, 
then the method 1500 proceeds to step 1556, where a request for the 
prior channel group is sent to the head end for processing. The 
5 method then proceeds to step 1558. If the query at step 1554 is 
answered affirmatively, then the method proceeds to 1558. 

At step 1558, the channel indicator is moved up by one 
channel content object 610. That is, the channel content object 
immediately above the presently indicated channel content object 
10 is now indicated. The method 1500 then proceeds to step 1510 to 
wait for the next user input. 

If the query at step 1544 is answered negatively, then the 
method 1500 then proceeds to 1548. At step 1548 a query is made as 
to whether the presently indicated channel is the last lower 
15 channel. That is, a query is made as to whether the presently 

indicated channel is channel content object 610-8, per FIG. 6. If the 
query at step 1548 is answered affirmatively, then the method 1500 
proceeds to step 1546. It is important to note that if the presently 
indicated channel is associated with channel content object 610-8, 
20 then a decrement command, as noted above with respect to FIG. 8B 
and path 832, requires the selection of the next channel PID to 
display the upper most channel of the next channel group (i.e., 
channel content object 610-1 of the next channel group). If the 
query at step 1548 is answered negatively, then the method 1500 
25 precedes to step 1560. 

At step 1560, a query is made as to whether a lower threshold 
has been reached. If the query at step 1560 is answered negatively, 
then the method 1500 proceeds to step 1568. If the query at step 
1560 is answered affirmatively, then the method 1500 proceeds to 
30 step 1562. 

At step 1562, a determination is made if the next channel 
group is available. This is, in a manner similar to that described 
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above with respect to step 1552, a determination is made if a 
presently broadcast, narrowcast, or pointcast stream includes an 
IEPG guide display including information related to the next 
channel group. The method 1500 then proceeds to step 1564. 
5 At step 1564, a query is made as to whether the next channel 

group is in fact available. If the query at step 1564 is answered 
affirmatively, then the method 1500 proceeds to step 1568. If the 
query at step 1564 is answered negatively, then the method 1500 
proceeds to step 1566. 

10 At step 1566, a request is made by the set top terminal to the 

head end for the head end to retrieve information associated with 
the next channel group (i.e., the guide and image portions of the 
IEPG display including the next channel group, or alternatively, a 
previously stored video screen including the appropriate 

15 information). As previously noted, by requesting such information 
at this point, the apparent latency of the system, as experienced by 
the user, is greatly reduced. The method 1500 then proceeds to step 
1568. 

At step 1568, channel indicators 641A and 641B are 
20 decremented or moved down by one channel content object 610. 

The method 1500 then proceeds to step 1510, where it waits for user 
input. 

FIG. 16 depicts a flow diagram of a head end stream request 
processing method. Specifically, FIG. 16 depicts a flow diagram of a 
25 method 1600 for responding to a request for a pointcast stream 

simple for use in a head within the information distribution system 
of FIG. 4 or 17. 

The method 1600 is entered at step 1602 and proceeds to step 
1604, where a request for a pointcast or a narrowcast stream is 
30 received by the head end. The method 1600 then proceeds to step 
1606, where a query is made to determine whether the requested 
stream is presently being provided to any user on the same QAM 
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information stream or forward channel stream. If the query at step 
1606 is answered negatively, then the method 1600 proceeds to step 
1608. If the query at 1606 is answered affirmatively, then the 
method 1600 proceeds to step 1604. 
5 At step 1608, the requested stream is constructed or retrieved 

from a storage device. In the case of real-time, synchronized 
encoding of a plurality of guide streams, the encoded, packetized 
stream is retrieved. The method then proceeds to step 1612. 

At step 1612, a PID is assigned to the retrieved or constructed 

10 stream and, additionally, a PID/Guide ID table associated with the 
QAM information stream is updated to indicate that the assigned 
PID is now associated with the requested stream. The method 1600 
then proceeds to step 1614 where a pointcast session is initiated in 
the manner described above with respect to FIGS. 2-5. The method 

15 1600 then proceeds to step 1616. 

It should be noted that the head end provides, for each QAM 
channel, a PID/Guide ID table stream that conveys to each STT the 
PID assignment for each stream being provided. In the case of the 
program guide streams, each program guide stream is represented 

20 in a relational way from the present-time broadcast guide streams. 
If user interaction indicates that a new guide stream is to be 
selected, the STT examines the PID/Guide ID to see which PID is 
associated with the Guide ID representing the new guide stream. If 
there is no PID entry in the table, then it is likely that a pointcast 

25 or narrowcast session is necessary to provide the new stream via a 
PID that is selected by the head end. 

Advantageously, the above-described embodiments of the 
invention utilize a very small amount of STT memory (typically less 
than 100Kb). Additionally, the invention takes the consumer 

30 navigation experience from the confusing guide presentations of 
the prior art, back up to the level of a television experience— and 
adds interactivity. This is achieved by basing the user interaction 
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model on a series of digitally-delivered, compressed video clips that 
include the appropriate guide information as integrated imagery 
along with, e.g., promotional video and audio information. In this 
manner, the local storage of guide data and the rasterization or 
5 compositing of the locally stored guide data at the set-top box is 
avoided. 

It must be noted that the above-described data structures and 
other methods provided for sending video streams to the set top 
terminals may be formed in accordance with the teachings of 

10 contemporaneously filed U.S. Patent Application Serial No. 

09/293,535 (the '535 application), which is incorporated herein by 
reference in its entirety. 

Specifically, the '535 application provides a data structure 
suited to efficiently representing a plurality of image streams 

15 including common and non-common portions. Specifically, a 
plurality of similar group of picture (GOP) data structures 
representing the corresponding plurality of image streams 
including common and non-common portions is adapted to provide 
a first encoded stream comprising only P-picture and B-picture 

20 access units of one of the similar GOP data structures, and a 
corresponding plurality of encoded streams comprising only 
respective I-picture access units of the similar GOP data structures. 
In this manner, the redundant P-picture and B-picture access units 
within the encoded streams are eliminated, thereby greatly 

25 reducing the bandwidth or memory resources needed to transmit 
or store the plurality of image streams. 

A data structure according to the '535 invention comprises: a 
multiplexed stream comprising a plurality of video streams 
representing respective first portions of a group of pictures (GOP) 

30 information structure, each of the respective first portions 

including an access unit associated with an I-picture and a video 
stream representing a remaining portion of the GOP information 



DIVA 070CON1 

-73- 

structure including at least one of an access unit associated with a 
P-picture and an access unit associated with a B-picture, wherein: a 
concatenation of one of the respective first portions of the GOP 
information structure and the second portion of the GOP structure 
5 results in a complete GOP information structure. 

Although various embodiments which incorporate the 
teachings of the present invention have been shown and described 
in detail herein, those skilled in the art can readily devise many 
other varied embodiments that still incorporate these teachings. 



